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The  Army  is  currently  engaged  la  e  large* scale ,  long-term  effort,  known 
as  Project  A,  to  develop  selection  and  classification  measures  that  are 
directly  linked  to  future  Army  performance.  Potential  selection  and 
classification  measures  already  developed  cover  four  broad  predictor 
domains-cognitive,  psychomotor,  temperament  and  interest.  Army  develop¬ 
mental  efforts  in  the  cognitive  and  psychomotor  domains  parallel  to  some 
extent  recent  developments  in  the  U.S.  Air  Force  and  Navy.  This  report 
presents  for  the  first  time  an  analytic  integration  of  the  cognitive  and 
psychomotor  measures  developed  by  the  three  services,  building  upon  recent 
work  by  R.  E.  Christal .  It  provides  a  catalogue  of  measures  available  in 
•ach  of  the  amjor  services  and  compares  measures  on  selected  character¬ 
istics.  The  information  provided  should  be  particularly  useful  to  potential 
test  users,  both  in  the  Army  and  in  the  other  services,  in  the  initial 
Identification  and  review  of  tests  for  particular  measurement  purposes,  and 
to  researchers  interested  in  the  test  domains  covered.  However,  this 
document  should  not  be  relied  upon  for  exhaustive  treatment  of  each  of  the 
tests  covered;  those  interested  in  more  detailed  information  should  consult 
the  relevant  documentation  provided  by  the  developing  agency. 

Project  A  was  authorised  through  a  Letter,  DCSOPS,  'Army  Research 
Project  to  Validate  the  Predictive  Value  of  the  Armed  Services  Vopational 
Aptitude  Battery*,  effective  19  November  1980;  and  a  Memorandum,  Assistant 
Secretary  of  Defense  (MRAfcL) ,  'Enlistment  Standards*,  effective  11  September 
1980. 


In  order  to  ensure  that  Project  A  research  achieves  its  full  scientific 
potential  and  will  be  maximally  useful  to  the  Army,  a  governance  advisory 
group  comprised  of  Army  General  Officers,  Interservice  Scientists,  and 
experts  in  personnel  measurement,  selection  and  classification  was  estab¬ 
lished.  Members  of  the  latter  component  provide  guidance  on  technical 
aspects  of  the  research,  while  general  officer  and  interservice  components 
oversee  the  entire  research  effort,  provide  military  judgment,  provide 
periodic  reviews  of  research  progress,  results  and  plans,  and  coordinate 
within  their  commands.  Recently  members  of  the  General  Officer's  Advisory 
Group  included  MG  V.G.  O'Leksy  (DMPM)  (Chair),  MG  C.F.  Briggs  and  MG  T.J.P. 
Jones  (FORSCOM.  DCSPER),  BG  V.C.  Xnudson  and  MG  J.B.  Allen,  Jr.  (DCSOPS),  BG 
F.M.  Franks.  Jr.  (DSAREUR,  ADCSOPS),  and  MG  J.B.  Corns  (TRADOC,  DCS-T).  The 
General  Officers'  Advisory  Group  has  been  briefed  periodically,  from  1983 
to,  most  recently.  May,  1987,  on  the  development  and  data  pertaining  to  the 
Project  A  cognitive  and  psychomotor  predictor  measures  described  in  this 
report.  Members  of  Project  A's  Scientific  Advisory  Group  (SAG)  guide  the 
technical  quality  of  the  research.  During  the  period  covered  by  this 
report,  they  included  Drs.  Philip  Bobko,  Thomas  Cook,  Milton  Bakel  (Chair), 
Lloyd  Humphreys,  Robert  Linn,  Larry  Johnson,  Mary  Tenopyr,  and  Jay  Uhlaner. 
The  SAG  has  been  briefed  biannually,  from  1983  to,  most  recently,  September 
1987  cm  the  Project  A  predictor  measures  described  in  this  report. 
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FOREWORD  (CONTINUED) 


A  comprehensive  set  of  new  selection/clessificstion  tests  end  job 
performance /training  criteria  have  been  developed  and  field  tested,  and  the 
revised  tests  have  been  administered  in  a  large-scale  concurrent  validation 
data  collection  effort.  Results  vill  be  used  to  link  enlistment  standards 
to  required  job  performance  standards  and  to  more  accurately  assign  soldiers 
to  Army  jobs. 
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A  COMPARISON  OF  THE  ARMY’S  PROJECT  A  COGNITIVE  AND  PSYCHOMOTOR  TESTS  TO 
ANALOGOUS  AIR  FORCE  AND  NAVY  TESTS 

EXECUTIVE  SUMMARY 


Requirement : 

To  compare  recent  tests  developed  by  the  Air  Force  and  Navy  with  that 
portion  of  the  Army’s  Project  A  predictor  battery  that  measures  cognitive 
and  psychomotor  aspects  of  human  performance.  The  purpose  was  to  identify 
areas  of  overlap  and  uniqueness  between  the  Army  tests  and  the  tests  of  the 
other  two  services. 

Procedure : 

The  author  reviewed  two  tri-service  reports  (Christal,  1984.  1985)  and 
reconstructed  descriptions  of  the  Air  Force  Human  Resources  Laboratory  and 
Naval  tests  into  tables  describing  the  tests  in  terms  of  the  following:  a 
brief  verbal  description,  experimental  design,  statistics  representing 
subject  performance,  reliability  and  construct  representativeness.  Tables 
detailing  each  test's  similarity  to  the  Army’s  Project  A  predictor  battery 
are  included. 

Findings : 

A  number  of  tests  being  developed  by  the  other  services  appear  to  be 
similar  to  the  Project  A  predictor  battery,  (e.g.,  Project  A’s  Number  Memory 
and  Memory  Scanning  Tests).  However,  there  appear  to  be  tests  unique  to 
each  service;  of  particular  note  is  the  use  of  the  paired-associate  paradigm 
for  a  number  of  tests  developed  by  the  Air  Force.  Tests  that  neither 
service  appears  to  be  stressing  or  developing  in  the  programs  covered  by  the 
present  report  include  selective  attention  measures. 

Utilization  of  Findings: 

The  findings  suggest  that  the  Project  A  predictor  battery  includes 
measures  of  common  interest  with  the  other  services,  but  that  there  may  be 
measures  which  one  or  the  other  of  the  services  is  developing  which  may  be 
candidates  for  supplements  to  the  Project  A  Battery.  These  include  measures 
that  focus  on  (a)  handling  information  overload,  (b)  handling  a  continual 
stream  of  competing  information,  or  (c)  capturing  learning  rates  of  tasks 
that  appear  to  be  essential  components  of  one  or  more  real  world  tasks.  A 
data  base  that  defines  tests  in  terms  of  the  primary  test  characteristics 
Identified  by  this  report  may  allow  for  more  systematic  listing  of  tests  for 
determining  further  candidate  measures  of  potential  use  in  Army  selection 
and  classification  testing. 
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INTRODUCTION 

Mark  Y.  Czarnolewski  and  Michael  6.  Rumsey 

Paychology  has  recently  seen  an  explosion  of  measures  which  capture 
reliable  individual  differences  in  performance  in  the  content  domains  of 
cognitive  psychology,  psychomotor  performance  and  ability  testing  (Hunt  ( 
Pellegrino,  1985).  These  new  measures  have  operationalized  constructs  that 
appear  sensitive  to  a  person’s  ability  to  use  different  types  of  information 
(s.g. ,  verbal  versus  physical  types  of  information)  or  to  a  person's  ability 
to  use  search  strategies  when  making  a  decision  based  on  that  information 
(e.g.,  exhaustive  versus  self -terminating  decision-based  searches). 

Many  of  these  new  measures  of  individual  differences  represent  more 
dynamic  testing  situations  than  the  paper  and  pencil  individual  difference 
measures  classically  found  in  the  literature.  Microcomputers  are  increas¬ 
ingly  becoming  more  adapted  to  mass  testing  of  these  dynamic  situations, 
with  the  esult  that  a  variety  of  these  measures  can  be  used  for  either 
selectio  and  classification  or  diagnostic  purposes. 

The  military  services  are  currently  developing  and  augmenting  their 
test  batteries  for  both  predictive  and  diagnostic  purposes.  Christal  (1984, 
1985)  lists  tests  being  developed  by  the  U.S.  Army,  Air  Force,  and  Navy,  a 
separate  Tri-Services  research  effort  that  has  input  from  the  above  three 
services,  and  military  services  of  other  countries,  most  notably  Canada  and 
England.  Christal 's  reports  provide  lists  of  tests  and  appear  to  allow  each 
of  the  services  covered  to  present  information  of  their  developing  tests  in 
a  format  selected  by  that  service. 

Christal 's  reports,  however,  do  not  attempt  to  look  at  the  interrela¬ 
tionships  among  the  tests.  The  identification  of  tests  is  a  worthwhile 
service,  but  greater  understanding  of  the  services'  testing  programs  and  the 
interrelationships  among  the  described  tests  is  needed.  There  is  a  need  to 
identify  test  characteristics  which  allow  one  to  compare  and  contrast  the 
different  tests. 

The  present  report  attempts  to  compare  a  number  of  the  tests  in 
Christal 's  reports  in  terms  of  the  operational  procedures  that  appear  to  be 
required  to  perform  the  tests  and  in  terms  of  the  constructs  that  the  tests 
are  designed  to  represent.  The  report  also  refers  to  methodologically  sound 
and  theoretically  based  concepts  so  that  the  reader  can  get  a  ’handle*  on 
the  large  number  of  diverse  measures  that  are  described  in  Christal 's 
reports . 

This  report  will  reflect  the  investment  into  test  development  from  the 
U.S.  Army’s  perspective;  specifically,  the  report  will  briefly  describe  the 
research  efforts  and  specific  tests  being  developed  by  the  U.S.  Army,  Air 
Force  and  Navy.  The  report  will  then  attempt  to  focus  on  the  Army  measures 
by  comparing  these  measures  to  the  measures  of  the  other  two  services. 

The  Army  research  project  which  is  developing  the  predictors  reviewed 
in  this  report  is  called  Project  A  (Eaton,  Goer,  Harris  &  Zook,  1985). 
Project  A  is  designed  to  evaluate  and  update  the  selection  and  classifica¬ 
tion  system  of  the  Army.  The  project  entails  the  development  of  both 


criterion  end  predictor  measures,  with  the  intent  that  the  developed 
predictor  measures  and  the  currently  used  predictor  measures  (the  latter 
being  the  Armed  Services  Vocational  Aptitude  Battery  or  ASVAB)  be  validated 
against  the  criterion  measures  (Eaton  et  al.,  1985).  The  intent  of  the 
present  report  is  to  describe  a  portion  of  the  research  effort  of  Project  A 
and  to  compare  the  described  portion  of  Project  A  to  similar  efforts  of  the 
Air  Force  and  Navy.  Specifically,  of  the  four  original  predictor  constructs 
of  interest  in  Project  A  -i.e.,  Cognitive,  Psychomotor,  Temperament  and 
Interest  (Peterson,  1985)-  the  present  paper  will  deal  with  just  the  first 
two. 


This  report  is  not  intended  to  be  a  comprehensive  literature  review  of 
cognitive  measures  or  psychomotor  skills,  in  general,  or  of  all  Air  Force, 
Navy  and  Army  tests  designed  to  represent  these  domains  of  behavior. 

Rather,  the  intent'  is  to  restructure  the  extensive  verbal  descriptions  of 
many  of  these  tests  that  are  described  in  Christal’s  reports  into  a  tabular 
format  that  facilitates  direct  comparison.  The  tables  contain  brief 
descriptions  that  highlight  relevant  task  and/or  psychometric  charac¬ 
teristics  of  each  test. 

The  structure  of  the  report  reflects  the  intent  of  preliminary  evalua¬ 
tion  and  across  service  comparisons.  First,  each  service's  test  development 
program(s)  is (are)  described  briefly,  and  each  program’s  tests  are  described 
and  critiqued.  Afterwards,  comparisons  are  made  between  Project  A  tests  and 
the  Air  Force  and  Navy  tests.  These  comparisons  include  discussions  of  the 
research  activities  of  these  three  services  and  categorization  of  the 
research  activities  as  ■similar",  ■different",  or  'not  dealt  with". 
Concluding  comments  suggest  that  the  perceived  overlaps  and  distinctions 
among  the  services  may  be  reflecting  the  common  and  unique  research  -ques¬ 
tions  that  each  service  seeks  to  answer. 

It  should  be  noted  that  this  report  labels  both  ability  tests  and 
information-processing  tasks  as  cognitive  measures.  It  Bhould  also  be  noted 
that  a  variety  of  approaches  have  been  used  to  study  such  measures.  One 
approach  attempts  to  further  the  understanding  of  a  construct  by  exploring 
the  psychometric  characteristics  of  a  test  that  is  developed  to  represent 
that  construct.  Using  this  psychometric  approach,  researchers  have,  for 
example,  developed  reliability  techniques  to  evaluate  a  test’s  measurement 
consistency,  and  have  developed  factor  analytic  techniques  to  define 
particular  constructs  and  to  test  their  validity.  A  second  approach  uses 
experimental  manipulations  to  examine  human  behaviors  associated  with 
particular  constructs.  From  this  approach  have  come  methodologies  to 
represent  learning  strategies,  as  well  as  search  and  other  deci6ion-making 
strategies . 

The  recent  integration  of  the  two  previously  disparate  areas  of 
psychometrics  and  experimental  psychology  is  found  in  the  study  of  individ¬ 
ual  differences  in  learning  or  information  processing  tasks.  This  integra¬ 
tion  is  exemplified  by  Hunt’s  (1978)  work,  which  factor  analyzes  a  number  uf 
experimental  tasks  to  construct  a  model  of  attention,  or  by  Sternberg 
(1977),  who  employs  an  experimental  manipulation  of  an  inductive  reasoning 


task;  a  task  which,  in  the  past,  would  have  been  described  and  constructed 
in  terms  of  psychometric  techniques.  Identification  of  individual 
differences  may,  thus,  be  achieved  by  either  psychometric  or  experimental 
approaches  for  studying  human  behavior.  The  present  paper  attempts  to 
capture  the  more  integrative  approach  by  reporting,  where  possible,  informa¬ 
tion  on  a  given  task  or  test  in  terms  of  psychometric  and  experimentally- 
based  descriptors. 

The  author  of  this  report  must,  however,  acknowledge  an  inconsistency 
in  the  coverage  of  the  tests  in  this  report.  One  inconsistency  is  due  to 
the  reference  documents'  (i.e.,  Christal,  1984,  1985)  not  employing  the  same 
descriptions  for  evaluating  each  test's  properties  (e.g.,  psychometric 
properties).  The  other  inconsistency  is  due  to  the  author's  desire  to 
discuss  the  paradigms  on  which  some  of  the  tests  are  based  to  highlight 
unique  characteristics  of  the  tests  or  to  comment  on  the  ways  those  tests 
are  or  are  not  being  used.  For  example,  there  is  a  discussion  of  a 
subject’s  performance  changes  when  taking  tests  that  are  given  over  repeated 
blocks  of  trials.  This  discussion  is  found  in  a  section  describing  measures 
of  automaticity  -  a  paradigm  in  which  extensive  practice  results  in  a 
qualitative  change  in  the  strategy  a  subject  employs  when  performing  certain 
tasks.  The  author  briefly  describes  the  theory  involved  in  the  automaticity 
paradigm  and  points  out  other  possible  experimental  strategies  than  the  ones 
currently  being  considered  by  the  service  using  the  paradigm  (e.g.,  the  Air 
Force).  Such  a  discussion  would  not  be  relevant  for  all  tests.  Comparisons 
between  measures  developed  by  psychometric  methodologies  and  measures 
developed  by  experimental  methodologies  are  also  found  only  in  sections 
where  such  discussions  are  relevant,  such  as  the  Air  Force  learning  curve 
parameter  identification  program.  The  research  focus  of  that  program 
suggests  that  one  may  define  a  given  learning  task  in  terms  of  an  ability 
that  is  defined  by  a  test  from  the  psychometric  tradition,  or  by  a  cognitive 
operation  from  the  experimental  tradition  --  a  point  which,  again,  would  not 
be  relevant  for  all  tests  covered  by  this  report. 

In  summary,  this  report  is  intended  to  do  the  following: 

.  Describe  cognitive  or  psychomotor  measures  being  employed  by  primary 
research  efforts  in  the  Army,  Air  Force  and  Navy.  These  include  Air 
Force  and  Navy  tests  as  of  1985  and  Army  tests  as  of  1986. 

.  Provide  the  reader  with  some  background  on  the  paradigms  or  theories 
on  which  some  of  the  tests  are  based; 

.  Where  the  available  background  information  permits,  specify 
particular  ways  in  which  the  tests  might  be  used  as  predictors  or 
diagnostic  tools; 

.  Compare  the  Army’B  Project  A  cognitive  and  psychomotor  measures  to 
the  Air  Force  and  Navy  tests  in  terms  of  each  test's  stimulus  charac¬ 
teristics,  construct  representativeness,  or  paradigmatic  foundation; 


.  Identify  similarities  and  differences  between  Project  A  cognitive  and 


psychomotor  measures  and  the  Air  Force  and  Navy  cognitive  and  psycho¬ 
motor  measures;  the  discussions  on  differences  include  (a)  use  of 
different  tests  and  (b)  use  of  similar  tests  differently  (e.g.t  more 
or  less  practice). 

AIR  FORCE  PROGRAMS 

The  Air  Force  Human  Resource  Laboratory  (AFHRL)  research  programs 
appear  to  stress  identification  of  individual  differences  in  a  number  of 
tasks  representative  of  both  the  learning  and  information  processing  facets 
of  the  experimental  literature.  Two  of  the  programs  are  the  Basic 
Attributes  Test  (BAT)  Program  and  the  Learning  Abilities  Measurement  Program 
(LAMP).  A  brief  description  of  each  program  and  its  respective  tests 
follows.  The  LAMP  project  is  the  more  extensive  of  the  two  programs; 
consequently,  mosC  of  this  section  will  discuss  LAMP. 

Basic  Attributes  Test  Program 

The  Basic  Attributes  Tests  (BAT)  were  designed  to  predict  aircraft 
pilot  performance.  Two  behavioral  domains  represented  include  personality 
assessment  and  information-processing  'capability*  identification.  The 
intent  for  the  latter  domain  was  to  identify  tasks  that  measure  the  abili¬ 
ties  to  quickly  sort,  prioritize  and  act  on  a  continual  Btream  of  visual, 
auditory  and  tactile  information.  The  personality  measures  of  the  BAT  are 
included  in  the  present  review  of  cognitive  and  psychomotor  measures  because 
a  number  of  the  personality  measures  are  of  a  dynamic  nature  and  require 
computer  administration.  They  were,  therefore,  considered  relevant  to  this 
review. 

The  BAT  tests  are  listed  in  Table  1.  Numbers  are  used  to  identify  a 
test’s  location  in  the  table.  Sections  of  the  table  are  not  filled  in 
because  relevant  information  was  not  provided  by  the  Christal  reports.  This 
format  is  applied  for  all  tables  in  this  report. 

The  tests  in  Table  1  include,  from  the  classical  psychometric  tradi¬ 
tion,  abilities  adapted  for  computer  testing,  such  as  Perceptual  Speed  (1) 
and  Field  Dependence  (10).  Information  processing  paradigms  from  the  1970s 
include  encoding  speed  (4),  mental  rotation  (5)  and  item  recognition  (6). 
Channel  capacity  models  from  the  1960s  are  represented  by  Time-Sharing  (3), 
which  includes  the  ability  to  simultaneously  process  information  load  and 
tracking  information,  and  Decision-Making  Speed  (8),  which  requires  the 
ability  to  process  an  increasing  amount  of  information  load.  A  psychomotor 
task  (16)  is  also  included. 

The  BAT’S  label  of  Encoding  Speed  for  one  of  its  tests  deserves  com¬ 
ment.  This  task  was  developed  by  Posner  (Posner,  Boies,  Eichelman  fc  Taylor, 
1969)  and  may  be  more  accurately  described  as  a  SAME-DIFFERENT  judgment  task 
that  distinguishes  between  nominal  and  physical  identity  (Nickerson,  1972; 
Posner,  1978).  The  term  'encoding*  is  usually  employed  to  represent  one  of 
the  hypothesized  information  processing  stages  for  this  task  (Farrell,  1985; 
Krueger,  1978,  Nickerson,  1972). 


Table  1 


Air  Force  Basic  Attributes  Test 


Task 

Name 

Task 

Description 

Design 

Statistic 
of  Interest 

1.  Perceptual 
Speed 

Press  buttons  In  sane 
order  as  sequential 
presentation  of  digits. 

Digit  Size  -  4 

2.  Dot 

Estimation 

Decide  which  of  two 
boxed'  has  more  dots 
(Compulsive  vs. 

Decisive  Behavior). 

3.  Tine 

Sharing 

Maintain  a  marker's 
position  In  a  compen¬ 
satory  task. 

i 

• 

Blocks  •  3:  5  trials/Block 

Blocks  (No  secondary  task 
vs.  Secondary  task  requiring 
observing  digits  and  pressing 
corresponding  buttons  vs. 

Same  secondary  task  but  with 
time  constraint). 

4.  Encoding 

Speed 

Posner  task  requiring 
SAME-DIFFERENT  judgments. 

Type  of  Identity  (Physical  vs. 
Nominal  vs.  Categorical,  e.g. 
consonant  or  vowel). 

5.  Mental 
Rotation 

Task  requires  SAME- 
DIFFERENT  Judgments. 

Perspective  (SAME  vs.  Mirror 
Image);  Orientation  (SAME  vs. 
Rotated). 

6.  Item 

Recognition 

Sternberg  Task  •  Decide 
whether  a  digit  was  pre¬ 
sent  or  absent  In  a 
previous  array. 

Memory  Load  (1  to  6  digits). 

7.  Immediate/ 
Delayed 
Memory 

Given  a  number  In  a 
sequence  of  numbers 
select  the  number  that 

Is  one  or  two  steps  back 
(Modified  Sternberg  Task). 

Memory  Load  (not  specified). 
Backtrack  from  Specified  Item 
(1  vs.  2  steps). 

Table  1  (Continued) 


Task 

Raae 

Task 

Description 

Design 

Statistic 
of  Interest 

6.  Decision- 
Nak 1 ng 

Speed 

Choose  correct  response 

In  a  simple  RT  task  with 
a  1:1  mapping  between 
stimulus  and  response 

Amount  of  Uncertainty  (2  vs.  4 
vs.  8  potential  stimuli)  x  Type 
of  Information  (where  and  when 
signal  will  occur  vs.  where 
signal  will  occur  vs.  when  signal 
will  occur  vs.  neither  where  nor 
when  signal  will  occur. 

».  Risk-Taking 

Out  of  10  boxes,  pick  as 
many  boxes  one-at-a-tlme 
without  picking  the 
‘disaster*  box. 

10.  Embedded 
Figures 

Decide  which  of  2  complex 
geometric  figures  contains 
a  specified  simple  figure. 

RT,  Errors 

11.  Self-Credit¬ 
ing  Mord 
Knowledge 

Project  own  performance 

In  a  vocabulary  task 
of  Increasing  difficulty. 

Blocks  -  3,  10  questions/ 

Block.  Increase  Difficulty 
(Block  1  vs.  Block  2  vs. 

Block  3). 

12.  Activities 
Interest 
Inventory 

Decide  Interest  between 
activities  differing  In 
danger  to  self. 

Pairs  of  activities  -  81. 

13.  Automated 
Aircraft 
Personality 
Profiler 

Decide  preferred 
attitude  and  Interest. 

Number  of  paired  choices 
-  200. 

14.  Biographical 
Data 

Identity,  Age 
Gender,  etc. 
Personal  His¬ 
tory.  Attitudes 
Toward  flying 

15.  Psychomotor-a 

Two-handed  coordination 

16.  Psychomotor-b  Coordinate  stick  and  rudder 


Personality  type  measures  include  Dot  Estimation  (2)  Risk  Taking  (9), 
Self  Crediting  Word  Knowledge  (11).  Interest  (12).  and  Personality  (13) 
profiles. 


Learning  Abilities  Measurement  Program 

The  Learning  Abilities  Measurement  Program  (LAMP)  is  a  long-term  basic 
research  program  intended  to  develop  a  theory-based  system  of  ability 
measurement.  The  program  relies  on  microcomputers  and  other  measurement 
devices  to  measure  previously  unevaluated  abilities,  response  latencies  and 
learning  efficiencies  under  laboratory-controlled  conditions. 

Four  programsare  embedded  within  the  Learning  Abilities  Measurement 
Program  (LAMP).  These  are: 

(a)  tasks  used  to  establish  a  baseline  of  information  on  Air  Force 
enlisted  personnel; 

(b)  learning  tasks  used  to  evaluate  learning  curve  parameters  in 
predicting  subsequent  learning  proficiencies; 

(c)  tasks  designed  to  measure  individual  differences  in  movement  toward 
automaticity ; 

(d)  tasks  constructed  for  use  in  various  in-house  experiments 
(Christal.  1984). 

Each  of  these  programs  will  be  discussed  in  turn. 

Baseline  Tasks 

Table  2  contains  a  list  of  the  information-processing  and  learning 
tasks.  The  table  contains  a  short  description  of  each  task,  the  experi¬ 
mental  design  embedded  within  each  task,  the  statistics  employed  to  repre¬ 
sent  subject  performance  and  the  reliability  of  those  statistics. 

The  tasks  include  simple  reaction  time  (RT)  (1)  and  binary  classifica¬ 
tion  tasks,  such  as  choice  RT  (2),  variations  on  the  Posner  Nominal-Physical 
Match  Task  (3,4),  Sternberg  Memory  Scanning  Task  (7a,  7b),  and  Neisser’s 
Search  for  Presence  Task  (21).  There  is  also  an  emphasis  on  paired- 
associate  tasks  of  various  forms.  These  include  the  basic  paradigm  (10), 
retest  format  (13),  retention  despite  interference  (i.e.,  retroactive 
interference)  (14),  and  updating  of  information  (19).  Another  memory  test 
is  the  missing  digit  task  (17).  Inductive  reasoning  tasks  are  represented 
(18,  20)  as  is  a  deductive  reasoning  task  (16).  Tasks  evaluating  the  effect 
of  sentence  structure  on  comprehension  are  also  represented  (9,  28). 
Construct  comparisons  between  these  measures  and  those  of  Project  A  will  be 
found  in  the  section  entitled  ’Army’s  Project  A  Predictor  Battery". 

Methodological  Issues.  An  initial  comparison  will  be  made  between  the 
Air  Force  Tests  and  the  Project  A  tests  to  highlight  the  test  character¬ 
istics  that  were  reviewed  to  both  describe  the  tests  and  to  use  as  standards 
for  comparing  the  tests.  The  description  of  the  Baseline  test  battery  is 


Table  2 


Air  force  Baseline  Tests 


Oats  and  Reliability 

Tank 

Kaaa 

Task 

Otscrlptlon 

Otslgn 

Statistic  of 
latarost 

Ra 1 lability 

Type 

Aaount 

1.  Staple  AT 

(locks  •  6;  K  trlals/llock 

Keen  RT 

Direct  Coaputetlon 

.99 

■locks  1,3,5  right  forefinger 

Odd/Even  Split-half, 

(locks  2,4,5  left  forefinger 

S.D.  RT 

Corrected  for  length. 
Odd/Even  Split-half, 

.99 

• 

(efl) 

.99 

2.  Two  Choice 

(locks  •  6;  20  trials/Block 

Keen  RT 

Method  of  Average: 

RT 

Correlation,  cfl 

.96 

Olrect  Coaputetlon 

.96 

3.  Posner 

■locks  •  2;  BO  trlels/Block. 

Nean  RT 

Test-Retest,  cfl 

.97 

Physical 
Natch  (PI) 

4.  Posner 

Within  each  Block, 

Blocks  •  2;  BO  trials/Block. 

Hean  RT 

laaedlate  Test-Retest 

.96 

Naae 

P.I.  •  43  trials. 

with  each  Block 

RI  •  PI 

Reliability 

Hatch  (NI) 

R.I.  •  37  trials 

Difference  Scores 

.43 

5.  Single  Word 

Categorise  words 

(locks  •  6;  20  trials/Block. 

Decision  Tlae 

Split-hair,  cfl 

.93 

Categorise- 

connotat Ion 

within  each  Block,  1/2 

Direct  Coaputetlon 

.99 

tlon 

trials  positive  and  1/2  trials 

Ruaber  Errors 

Split-hair,  cfl 

.75 

waget ive  connotation 

Categorliation 

Reliability  of 

Tlae -Two 

Choice  RT 

Difference  scores 

.69 

6.  Word  Pairs 

Pairs  of  Words 

(locks  •  2;  (0  trlels/Block. 

Hean  RT 

Spllt-half,  cfl 

.99 

Presented  Slaul- 

Type  of  connotation. 

taneously 

Positive  •  SAME 

Begat fve  •  Olff 

7a.  Sternberg 

Kenory  Scanning 

Heaory  Lead  (2, 3, 4,6) 

Overall  HeenRT 

Direct  coaputetlon 

.96 

Nuabers 

160  Trials 

Slope  Across  Load 

Split-half,  cfl 

.63 

Intercept  of  Slope 

Split-half,  cfl 

.66 

7b.  Sternberg 

Meaory  Scanning 

Heaory  Load  (2, 3, 4, 6) 

Overall  aeen  RT 

Direct  Coaputetlon 

.99 

Words;  exaalnees 

160  Trials 

Slope  Across  Load 

Spllt-half,  cfl 

.67 

receive  4  consec¬ 
utive  trials  at 

Intercept  of  Slope 

Split-half,  cfl 

.94 

a  given  eet  else 
for  7e.  7b. 

R.  Nuaerlcal 

A  separate  set  for 

Sets  •  S,  36  Trials/set 

Add.  Nean  (T 

Reliability 

.95 

Operations 

each:  addition. 

SO  RT 

Reliability 

.53 

subtraction. 

Subt.  Hean  RT 

Reliability 

.95 

alltlpllcatlon. 

SO  RT 

Reliability 

.50 

division,  alxed. 

Holt.  Nean  RT 

Reliability 

.91 

SO  RT 

Reliability 

.59 

Dlvs.  Hean  RT 

Reliability 

.93 

SO  RT 

Reliability 

.71 

Nixed  Hean  RT 

Reliability 

.97 

SO  RT 

Reliability 

.75 

Acta.  Cf)  •  corrected  for  length 


I 

I 

< 

i 

l 
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Table  I  (Continued) 

Air  fore*  But  11  in  Te*t* 


Date  i*4  Reliability 


Task 

De*cr1pt ton 


Statlftlc  Of 
Inttrnit 


tnltnb titty 
Typ* 


9.  Sentence  OotoralM  truth  or  Sot*  •  4,  )2  tentencet/aet,  ttoa*  Corroct 


10.  Paired 
AtiOClOttt 
Looming 


Moyer- 

Londtutr 


12.  Cholct  RT 


Vorlflcotlon  faldty  of  (tap It  Foe tor  It  1  Dedgn:  *To 

ttnttncot  of  tht  follow*  »*.  *To  Proetdt* 
following:  X  0  Active  v*.  Poittvo 
tkt  X  1*  net  Podtlve  vt.  Negative  Fora 

follwtd  ky  tkt  0.  0  flmt  v*.  X  first 

Ltort  t.  sing  to  10  atteclatlont;  Criteria: 

digit  nuaktr  ttsoc-  a)  got  10/10  corroct  1*  ony 


lattd  with-*  low 
Olloct'CVC  trlgrto 


2  of  3  contecutlvt  block* 
or  k)  cant  lout  until  25th 
block 


Naan  flat  to 


Avtrogt  Subtttt 
Uttreorrt  lotion, 
efl 

Avtrogt  Subtttt 


Subject  decide*  the  Sot*  •  2;  22  digit  pelrt/ttt 
larger  of  two 
horizontally 
adjoining  digit*. 


Subject*  prlatd  for  Hock*  •  S,  AO  trial*/* lock. 
Quaker  of  itlaull,  Stlaulu*  load  (2, 1,4, 5) 
with  1:1  etlaulu*: 
retponte  napping. 

Capture*  handling 
of  Inforaatlon 
tranultdon,  per  te. 


Coaplete  Fora 

Intercom*  let  Ion 

.94 

Quaker  of  trial* 

required  to  Team 

Individual  word 

Coefficient 

Alpha 

.71 

Naan  RT 

Te*t-Rete*t, 

efl 

.99 

Slope  •  fvne.  (digit  dlff) 

Teat-Rettit, 

efl 

-$4 

Intercept  of  ’dlff*  tlope 

Te it -Re test, 

efl 

.97 

R-Sguart  of  'dlff*  dope 

Teit-Retett. 

efl 

.47 

Slope  •  rune,  (digit  ratio) 

Teit-Reteit, 

efl 

.54 

Intercept  of  ‘ratio*  tlop* 

Teit-Retett, 

efl 

.94 

R-Sguart  of  ‘ratio*  *lop* 

Te*t-Retett, 

efl 

.49 

Slope  RT  at  e  function 

of  1og-ba*t-2  (Q*l) 

Reliability 

.73 

Intercept  of  dope 

Reliability 

.70 

Correlation  of  tlop* 

Reliability 

.34 

13.  Relearning 
of  Paired 
At toe  late* 


Ra-edalnliter  Tatk 
10  end  coaputt  pro¬ 
port  Inal  reduction 
In  learning  trial* 


See  Ta«k  10. 


14.  Old-New  Preatnt  one  word  at  Trial*  •  200  coaeon  noun*. 
Word  Mtaory  «  tie*  and  tubjtct  No.  of  latervanlng  wordi 
decide*  If  word  we*  (0,1, 2, 3,4, 5). 
preiented  btfora. 


Proportional  reduction 
1r  Iteming  trial* 

Trial*  required  to  Item 


RT  for  leg  and  aaw  wrdt 


Coefficient 
Alpha  .44 

Coefficient 
Alpha  .27 

Direct  coaputatlon, 
the  average  of  (In 
relltbllltit*  .19 


IS.  Randoa 
Production 


Tap  two  key*,  with 
re»pect1vt  fore¬ 
finger*.  Etch  te- 
due nee  of  tapping* 
art  aubjectlvely 
choaen. 


Four  tegutncei  of  120 
retponte*. 


All  of  the  following  were 
coaputtd  by  the  tvg. 
aubitt  Intercom* letlon, 
Cf!  ph 1-1- .44; 
phl-2-.tl;  ph1-3*.»l; 
phi-4-. 72;  ph1-5*.S4 


14.  Three-Tera 
Serltt 


Coapart  and  atkt  a  Set*  •  3;  32  probleat/eet. 

cholct  baaed  on  Sat  1:  Dick,  John,  Pate; 

Information  In  two  ahort-tell. 

conttcutlvt  tent-  Sat  2:  Dick,  John,  Pete; 

once*,  e.g.,  John  good-bed. 
not  a*  tall  a*  Pete,  Set  3:  Red,  Hue,  fellow; 
Pet*  not  at  tall  a*  rough-aaooth. 

John.  Who  1*  abort- 
ett  1)  Olck  2)  John 
I)  Pete. 


Retponte  flat 


Quaker  Correct 


Teat  Internal  Ceailatency 


Keen  eebteat 

Intercom*  la  t  ton, 
efl  .92 

Mean  tebtatt  Inter¬ 
com*  let  Ion,  efl  .95 

Keen  KX-21  for  the 
throe  tufcttitt  .9$ 


Table  2  (Continued) 

Air  Fort*  la saline  Tests 


Tart 

Rom 

Talk 

Deacrlptlon 

Design 

Data  and  Reliability 

Statistic  of  Reliability 

Interest  Type  Amaat 

17.  Hoaory  Span 

Decide  which  one  of 

•locks  •  4;  27  Trlals/tlock 

Coaputed  wwry  span 

Avg-subtest  Inter- 

prevloudy  (tucces- 

correlation,  cfl 

.M 

alvely)  presented 

Coaputed  span  over  four 

Direct  confutation 

.94 

nine  digit!  It 

Hocks 

■tiling. 

RT 

Direct  confutation 

.99 

11.  Pattarnt 

Oat  of  Tour  groepi 

RT 

Direct  confutation 

.15 

to  Latter 

of  letten,  detect 

Internal  Consistency 

KR-21 

.71 

Serial 

end  identify  aooaa- 

Ruaber  Correct 

Split-half,  cfl 

.13 

lout  group. 

If.  Contlnuoui 

Subject i  associate 

1 locks  •  4,  SO  Trills /block 

RT 

Direct  Confutation 

.15 

Paired 

teaperatures  with 

lag  (0  Thru  1)  -  auaber  of 

Proportion  Correct 

Split-half,  cfl 

.90 

Aiioc latei 

each  of  four  cltlei. 

teaperatures  between  pre¬ 

Slope  Prop.  Cor. 

Split-half ,  cfl 

.73 

where  teeperaturei 

sentation  of  a  city’s  taap. 

regressed  on  lag 

are  frequently 

and  the  question  about  tbe 

Intercept 

Split-half,  cfl 

.94 

- 

changing. 

taap. 

20.  Slwn  and 

Choose  the  letter 

IS  test  questions. 

Internal  Consistency 

KR-21 

.56 

Kotolvtky 

which  continues  a 

of  right-wrong 

(Lett  latter 

serial  of  letters. 

of  Pattern) 

21.  Visual  Scan 

Search  for  a  letter 

■locks  •  4.  20  Trlels/Block 

Seen  Rate 

Direct  Confutation 

.97 

(Reliter‘1 

In  a  Mtrln  of 

Correct  Identification 

Average  Subtest 

Pretence 

letters,  with  rows- 

Intercom  let  Ion  cfl 

.19 

Tart) 

20  and  coluant  •  7 

22.  Line  Length 

Pick  the  longer  of 

•locks  •  4,  32  Trie li/I lock 

d’ 

Tost-Retest,  cfl 

.73 

Jedgwnt 

two  contiguous 

beta 

Test -Retest,  cfl 

.13 

horliontal  llnei 

23.  Sunday- 

Per fore  symbolic 

Sots  •  2,  49  problaat/Mt 

Naan  RT 

Test-Rctest,  cfl 

.94 

Tueiday 

arlthwtlc  with 

S.D.  RT 

Test-Retest,  cfl 

.12 

Talk 

Honday  -  1  and 

Ho.  of  Iteas  correct 

KR-20 

.96 

Sunday  •  7,  Answers 

are  days  of  the 

week,  wt  nwaberi 

24.  Sewntlc 

Preient  two  words 

■locks  •  3,  102  pairs/Block 

RT  difference  btwn 

Spit-half,  cfl 

.17 

Prising 

and  decide  if  both 

loth  words  (pa1rs«34).  loth 

related  and  unre¬ 

Reliability  of 

words  are  real. 

aonwordt  (pa1rt*34).  One 

lated  pairs 

difference  scores 

.76 

word  real  (pa1rs*6B).  loth 
word j  real  and  sewntlcally 
relatad,  e.g. ,  doctor/nurie 
(pairs* 102).  loth  word!  rod 
and  not  teaentlcelly  related 
(pa1rs*102) 


Judge  whether  • 
rotttod  figure  It 
tht  sew  ti  n  up¬ 
right  figure  on 
U*  toft. 


Trials  •  200. 

Oodlloh  (S«M  -  120  Trials 
vt.  OUf  •  10  trials). 
Rotation  (50,10.150  degrees). 


.71 


25.  lotltod 
Figures 


IT  i  top*  oeron 
rotl t Ion 


Split-half,  eft 


Table  2  (Continued) 

Air  hftl  ItnllM  T«»t» 


Task 

Description 


Design 


Oats  end  la liability 


Statistic  of  lallablllty 

IiUroit _ Typo  Aaoent 


H.  OmI  Uit 


Continuously  tap  at 
a  MMdy  r»t»  while 
perforalng  secondary 
to Ik i  of  varying 
difficulty  requiring 
•oorcklag  for  a  «  la 
a  latter  array. 


Condition  •  I,  4  la  aacaadlag 
order  of  difficulty  oad  tke 
aaae  4  deicoudlag  1)  patellae, 
I)  letter  array  with  O't,  3) 
array  with  curved  latten,  4) 
array  with  aagular  let tar i. 


Nlckoa  perceptual  aotor 
load  •  (loaded  tapplag- 
aaloeded  tapping)/ 
aaloaded  tapping. 


Avg.  Sabtest 
latercorrelattoa,  .(5 
cfl 


27.  Ickakawe 
Skort -taro 
Neaory  for 
Visual 
Position 


Aatpond  If  a  pattern 
of  3  points  foraod  Py 
nuccosslvely  present¬ 
ing  1  potnt'dn  seek 
of  3  (5  pt.  a  t  pt.) 
act rices  nat  proaptad 
by  a  prior  stellar 
criterion  aatrla  vltk 
7  rendoaly  selected 
net  Mi  points. 


Sots  •  t,  30  Trials/tat 
Presentation  delay  It  1,  1  and 
t  sac.  after  off  sat  of 
erlglaal  aetrU. 


luaber  Correct  An evert 
Slope  of  Ho.  of  Heat 
correctly  ansvered 
regressed  delay 
Intercept 


Spnt-keir, 

cfl 

.40 

Split-half, 

cfl 

.24 

Split-half, 

cfl 

.77 

21.  Collins 
end 

Qullllan 


Answer  true/false  to 
a  sentence  wtiose  sub¬ 
ject  and  predicate 
differ  In  linguistic 
and  coaglitlve 
coap lenity. 


Sentences  •  104 
P  sentences  refer  to  subject 
properties,  e.g.,  Wool  It 
soft.  S  sentences  refer  to 
category  anabertklp,  e.g., 
Ckrtstast  Is  a  holiday, 
level  difference  (0,1,2). 


Slope  of  IT  repressed 
on  difference  In  levels 

Difference  btwn  Level 
0  and  Level  1  IT 


Odd/even  split, 
cfl  for  $  condi¬ 
tion  .44 

P  condition  not 
significant 

P  condition 
re let lontk Ip  of 
difference  .10 


S  condition 
relationship  of 
difference 


.54 


more  detailed  than  the  previously  reviewed  BAT  battery  because  the  documents 
reviewed  for  this  report  (i.e.,  Christal,  1984,  1985)  did  not  provide  as 
much  detail  of  test  characteristics  for  the  BAT  battery  as  for  the  Baseline 
test  battery.  It  was,  thus,  felt  that  this  initial  comparison,  which  is  de¬ 
signed  to  sensitize  the  reader  to  the  test  character-istics  that  will  be 
used  to  compare  the  Project  A  tests  to  the  Air  Force  and 
Navy  tests,  would  best  be  served  when  describing  the  Air  Force  Baseline 
tests. 

Baseline  tests  contain  more  trials  per  task  than  found  in  Project  A. 

For  example,  the  Air  Force’s  Sternberg  task,  using  digits  for  stimuli  (7a), 
contains  160  trials  while  the  Sternberg  task  in  the  Project  A  battery 
contains  36  trials,  with  1/3  of  the  stimulus  trials  containing  digits. 

As  seen  in  Table  2,  the  Air  Force’s  method  to  assess  task  reliability 
is  not  constant  across  tasks.  Split-half  reliabilities  based  on  odd-even 
(parallel)  items  are  computed  for  some  tasks  while  other  methods  were  used 
for  other  tasks.  The  "Direct  Computation*  method  is  not  defined  in  Christal 
(1984) . 

Project  A  has  employed  test-retest  and  split-half  reliability  measures 
for  its  computer  tasks  (Toquam,  Dunnette,  Corpe,  McHenry,  Keyes,  McGue, 
Houston,  Russel  &  Hanson,  1985).  Much  concern  has  been  directed  toward  the 
psychomotor  tasks  because  these  measures  traditionally  show  low  test-reteBt 
reliabilities. 


The  issue  of  adequate  test-retest  reliability  may  be  reconceptualized 
as  consistency  in  performance  over  many  trials  (Rogosa,  Brandt  &  Zomowski, 
1982;  Tucker,  1966;  Zeaman  &  Kaufman,  1955).  Low  reliabilities  may  be 
reflecting  individual  differences  in  learning  rate  for  these  tasks.  One 
issue  of  possible  interest  is  whether  statistics  reflecting  subject  learning 
may  provide  reliable  and  valid  indicants  of  predictor  performance. 

Tasks  used  to  evaluate  learning  curve  parameters. 

Table  3  contains  learning  tasks  used  to  evaluate  curve  parameters  in 
predicting  subsequent  learning  proficiency.  The  table  appears  to  contain 
job-relevant  criterion  tasks  that  are  administered  via  a  paired-associate 
format.  For  example,  the  Emergency  Procedures  Task  requires  that  subjects 
learn  critical  (job- related)  steps  and  those  steps’  relative  order  of 
performance.  The  task  is  structured  so  that  one  can  repeatedly  measure  a 
subject's  performance  as  he/she  is  learning  the  task. 

A  number  of  positive  points  may  be  made  regarding  the  Air  Force’s 
research  strategy  of  identifying  tasks  and  their  respective  critical 
behaviors,  and  restructuring  those  tasks  to  fit  an  experimental  paradigm. 
These,  first,  include  the  employment  of  sensitive  dependent  measures  For 
example,  one  can  measure  RT  to  the  millisecond  and  distinguish  between 
errors  of  commission  and  omission.  Second,  one  may  vary  the  tasks  by 
employing  a  componential  approach  or  introduce  other  independent  variables. 
Third,  one  may  impose  various  experimental  frameworks  onto  the  task,  e.g., 
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Task  Hu*  ltd 

Poser Ipt  tea 


Design  and  Statistic 
of  Intaratt 


Cognitive  Factors 


Operat Ions 


1.  Codad  Nassagas:  Fora  Introductory  Phase:  Associativa  Naaory 

associations  between  laarn  associations  of  Logical  Reasoning  or 

abstract  syabols  and  4  syabols/subsat,  aubsat-3.  Logical  Evaluation, 

corresponding  words  Test  Phase;  Perceptual  Spaed, 

and  coablne  these  sya-  Decide  If  word  aassaga  and 

bols  Into  stateaents.  syabol  aassaga  are  Identical. 

Nuaber  decoding  syabols  (4,5,S) 

RT  and  error. 

2.  Eaargancy  Procedures:  Introductory  Phase:  Does  not  translate 

Learn  and  recall  Learn  In  order,  the  first  4,  easily  Into  derived 

laforaatlon  organised  the  first  t,  and  then  all  12  Factors. 

as  an  ordered  set  of  steps  In  a  procedure, 
stateaents.  Test  Phase: 

Decide  If  stated  ordinal  rela¬ 
tionship  between  two  steps  is 
correct.  RT  and  error. 

3.  Tlae  Check:  Read,  Introductory  Phase:  Perceptual  Speed, 

adjust  and  coapare  Learn  association  between  clock  Spatial  Relations, 

values  froa  digital  face  and  digital  display.  Ruaberlcl  Coaputatlon, 

and  analog  Inforaatlon  Learn  relationship  aaong  the  Logical  Reasoning, 

displays.  different  tlae  zones. 

Test  Phase: 

Decide  If  a  digital  display  for 
a  given  tlae  zone  equals  a  pre¬ 
viously  presented  clock  display 
for  a  given  tlae  zone. 

Clock  feces  rotated  (0,90,1(0, 

270°),  with  outside  arrow  point¬ 
ing  to  clock's  12  o'clock 
position. 

4.  Security  cheek:  Introductory  Phase:  Associative  Neaory, 

learn  and  recall  an  Learn  In  order,  the  first  4,  Logical  Reasoning, 

ordered  set  of  aeanlng-  the  first  I,  and  then  all  12  Sequential  Naaory, 

ful  paired-associates  locations  and  their  associated 

security  designation. 

Test  Phase: 

Decide  If  a  stateaent  coopering 
2  locations  In  teras  of  the 
ordlnel  relationship  of  thslr 
associated  security  status  Is 
correct.  RT  and  error. 

5.  Coaaun lest  Ions  Control:  Introductory  Phase:  Verbal  Coaprshenslon, 

Reaeaber  hierarchically  Learn  3  channels  and  associated  Logical  Reasoning 

structured  verbal  codes,  with  each  code  associated  Associative  Neaory. 

Inforaatlon  with  different  types  of  Inforaa¬ 

tlon  reflecting  traffic  flow. 

Test  Phase: 

Decide  If  a  channel  Is  correctly 
associated  with  2  questions  re¬ 
questing  specific  Inforaatlon  re¬ 
garding  traffic  flow.  RT  and 


•aslc: 

Encode  words,  store  their 
aeanlng,  encode  syabols,  use 
visual  aeaory  to  coapare  the 
aeanlngs  of  the  words  and 
syabols,  coablne  these  sya¬ 
bols  Into  stateaents,  and 
execute  a  proper  response. 

Encode  a  series  of  state- 
aents  with  regard  to  their 
serlel  order,  string  and 
retrieve  this  Inforaatlon, 
coapare  serial  positions 
within  the  stored  Inforaa¬ 
tlon,  and  execute  a  proper 
response. 

Cognitive: 

Encode  a  digital  stlaulus, 
store  this  Inforaatlon, 
ancoda  an  analog  or  flg- 
aral  stlaulus,  coapara  the 
saaantlc  Inforaatlon  froa 
both  stlaull,  and  executa  a 
proper  response. 


Encode  a  series  of  paired- 
associates,  store  and  re¬ 
trieve  this  Inforaatlon, 
coapare  serial  positions 
within  the  stored  Inforaa¬ 
tlon,  execute  a  proper 
response. 


Cognitive: 

Encode,  store  and  retrieve 
linguistically  presented 
Inforaatlon  to  coapare  sea- 
antic  Input  with  this 
stored  Inforaatlon,  and  to 
axecuta  a  proper  response 
on  the  basis  of  the 
coaparlson. 


IVfi«ItVlVlUWttLtH«<Atri  >ii  ».t  «.i  u  U  >aA  . 
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Table  3  (Continued) 

Air  force  Learning  Tom  Used  to  Obtain  Learn  Inn  Curv.  Piroaettri 


Took  Nut  ond 

Ootcrlptlon 


Design  end  Stetletlc 
of  Interest 


Cognitive  Fedors 


Operetlons 


C.  Direction  Judgment: 
Store  end  retrieve 
laforaatlon  concerning 
visual  foras  end  their 
reletlonshlps  within  e 
two-dlaenslonel  errey 


7.  Streteglc  Decision: 


Reaeaber  nuaerlcel 

values  associated  with 

Other  stiaull  end  per- 

fora  nuaerlcel  opera- 

& 

Introductory  Phese; 

Study  the  locutions  of  12 
fettures  on  a  aep 
Test  Phese: 

Oeclde  If  e  feetere  Is  In  the 
suggested  direction  with  ragerd 
to  e  previously  presented 
feeture.  Or  lent et Ion  of  top  of 
previously  presented  feeture 
(North,  South,  Eest,  West). 

NT  and  error 

Introductory  Phese: 

Assoctete  nuaertcel  vslues  to 
e  set  of  stiaull  and  sue  the 
points  of  two  suhtests. 
Associate  one  rule  to  one  ratio 
between  the  two  subsets  end 
another  rule  to  another  ratio. 
Test  Phase: 

Answer  (Y/N)  If  a  suggested 
rule  applies  to  two  subsets 
of  stiaull. 


Visual  Memory, 
Spatial  Orientation, 
Perceptual  Speed. 


Nuaber  Facility, 
Central  Reasoning, 
Associative  Htaory. 


•as  1c: 

Encode,  store  end  retrieve 
vlsuo-spatlel  Information,  to 
eoapare  perceived  Information 
In  memory  and  to  execute  a 
proper  response  based  on  that 
comparison  process. 


Cognitive: 

Encode,  store  and  retrieve 
quantitative  Information  to 
apply  coaputetlonal  rules  to 
this  Information,  end  to 
execute  t  proper  response 
based  on  the  results  of  the 
coaputetlon. 


nt* * 


•peed-accuracy  tradeoff,  signal  detection,  or  as  found  here,  a  paired- 
associate  paradigm.  These  paradigms  may  allow  one  to  identify  critical  task 
components  and  provide  a  theoretical  framework  for  identifying  behaviors  (or 
processes)  of  interest. 

One  potential  negative  aspect  of  this  experimental  approach  is  the 
possibly  limited  transferability  of  an  *  experimental*  task  to  a  ’real  world* 
task.  The  extent  of  transferability  would  need  to  be  empirically 
determined. 


Integration  of  human  performance  measurement  disciplines.  The  reor¬ 
ganization  of  the  Air  Force's  learning  parameter  tasks  into  a  format 
depicted  by  Table  3  suggests  that  one  can  integrate  different  methodologies 
of  human  performance  measurement.  Table  3  shows  that  one  may  describe  the 
same  behavior  in  terms  of  (a)  job  behaviors  that  may  be  used  to  represent  a 
job-relevant  criterion,  or  (b)  abilities  that  are  defined  in  terms  of 
psychometric-based  methodologies  (e.g.,  the  factor  analytic  methodology  used 
to  define  the  cognitive  factor  of  Associative  Memory),  or  (c)  the  experimen¬ 
tal-based  methodology  that  isolates  the  operation  of  encoding,  comparing, 
combining,  etc.).  The  column  titled  'Cognitive  Factors*  identifies  abili¬ 
ties  that  are  described  in  the  psychometric  literature,  while  the  column 
titled  'Operations'  identifies  stages  of  information  processing  that  are 
described  in  the  experimental  literature. 

To  the  extent  that  psychometric-based  methodologies  represent  selection 
measures,  experimental  methodologies  are  representative  of  training 
approaches,  and  job-relevant  measures  represent  performance  measurement,  the 
mapping  represented  in  Table  3  suggests  a  possible  technique  for  linking 
these  three  human  resource  management  fields. 

For  example,  the  table  suggests  that  it  is  possible  that  a  measure  of 
perceptual  6peed  from  the  psychometric  literature  may  relate  to  a  criterion 
task  which  is  based  on  job  analytic  methodologies,  while  a  measure  of 
perceptual  speed  from  the  experimental  literature  may  relate  to  both  the 
psychometric  measure  of  perceptual  speed  and  the  criterion  task.  The 
experimental  task  may,  therefore,  be  unlikely  to  exhibit  incremental 
validity  in  the  statistical  sense.  However,  systematic  study  of  the 
experimental  task  may  highlight  the  independent  variables  and  their 
respective  levels  that  have  the  most  marked  effect  on  perceptual  speed  and 
criterion  task  performance.  Identification  of  powerful  independent  variable 
effects  could  then  suggest  avenues  for  treatment  intervention  (i.e., 
training  of  relevant  behaviors  or  strategies  predictive  of  performance). 

The  table  also  suggests  that  one  may  systematically  observe  a  subject’s 
learning  of  a  criterion  task.  For  example,  systematic  observation  of  the 
subject’s  task  learning  behaviors  may  identify  differences  between 
successful  and  less  successful  subjects  in  the  memory  aids  they  employ,  for 
example,  in  the  Time  Check  Task  (3).  Of  interest  would  be  the  Subject  X 
Learning  Parameter  interaction  for  Time  Check,  which  according  to  the  table 
would  be  represented  by  the  relationship  between  perceptual  speed 
(p8ychometrically  defined)  and  learning  parameters,  and  the  relationship 


between  perceptual  speed  (experimentally  defined)  and  learning  parameters. 
The  intent  is  to  observe  if  (a)  perceptual  speed  predicts  learning  per¬ 
formance,  (b)  components  of  perceptual  speed  (experimentally  defined) 
predict  learning  performance  and  (c)  components  of  perceptual  speed  (ex¬ 
perimentally  defined)  predict  different  components  of  learning  at  different 
stages  of  task  competency.  The  intent  is  not  to  go  into  an  'infinite  Do- 
Loop  of  research*,  but  rather  to  suggest  that  one  can  systematically  map 
criterion,  psychometric  literature  measures  and  experimental  literature 
measures  to  take  advantage  of  the  technologies  of  these  respective 
disciplines . 

Measures  of  Automaticitv 

Table  4  contains  tasks  designed  to  measure  individual  differences  in 
movement  toward  avrtomaticity .  Automaticity  reflects  a  developed  competency 
in  a  task  due  to  learning  (Schneider,  1985).  One  question  that  has  been 
raised  regarding  automaticity  research  deals  with  whether  the  learning 
reflects  a  more  specialized  way  of  using  the  same  resources  or  whether  the 
resources  are  different  from  the  ones  originally  used  as  one  learns  the  task 
(Logan,  1985).  Either  strategy  could  elicit  the  gradual  leveling  of 
performance  across  stimuli  of  varying  complexity.  This  effect  can  be 
studied  in  the  following  three  tasks  that  are  employed  by  the  Air  Force  in 
its  research  effort  studying  automaticity  with  the  intent  of  isolating  those 
factors  accounting  for  the  qualitative  changes  found  with  extended  practice. 

The  Perceptual  Matching  Task  (1)  represents  a  scanning  task  of  varying 
difficulty.  A  focus  of  interest  would  be  the  effect  of  practice  on  indi¬ 
vidual  differences  to  the  extent  that  the  more  difficult  matrices  (e.g., 
larger  and  less  discriminable)  elicit  performance  (e.g.,  reaction  times) 
that  approach  the  reaction  times  of  less  difficult  matrices.  (The  less 
difficult  matrices  would  be  smaller  and  more  discriminable  than  their  more 
difficult  counterparts.) 

The  Attribute  Comparison  Task  (2)  is  a  Posner  Task,  with  an  embedded 
variation  of  type  of  identity  (i.e.,  physical  vs.  nominal  vs.  categorical). 

A  focus  of  interest  would  be  the  effect  of  practice  on  individual 
differences  to  the  extent  that  more  complex  matches  (e.g.,  categorical 
matches)  elicit  performance  that  approaches  less  complex  matches  (e.g., 
physical  matches). 

The  Arithmetic  Operations  Task  (3)  contains  a  homogeneous  set  of  op¬ 
erations  for  all  but  one  of  the  blocks  of  trials,  A  focus  of  interest  could 
be  the  effect  of  practice  on  individual  differences  to  the  extent  that  more 
difficult  problems  (e.g.,  larger  sums)  elicit  performance  that  approaches 
performance  for  less  difficult  problems  (e.g.,  smaller  sums).  Individual 
differences  could  be  observed  for  each  block  of  trials. 


Vhen  observing  movement  toward  automaticity,  one  may  be  interested  in 
the  interaction  between  initial  task  performance  and  the  rate  of  improvement 
in  task  performance.  One  would  then  be  observing  the  interaction  between 
initial  ability  on  the  task  and  learning  rate  for  that  task. 


Table  4 


Air  Force  Tasks  Designed  to  Measures  Differences  In  Movement  Toward  Automatlclty 


Task  and 


Description 

Design 

Statistic  of  Interest 

Perceptual 

Sessions  •  8,  96  trials/session 

1. 

Slope  and  interest  of  positive 

Matching: 

'Matrix  Size  (3, 5, 7, 9)  elements 

and  negative  decisions. 

Decide  If 

Different  Degrees  of  mismatch 

2. 

Session  x  Slope  Interaction  for 

two  Matrices 

(0,1,2.  all  elements). 

each  decision.  Session  x 

match. 

3. 

Intercept  Interaction  for  each 
decision. 

Trial  effect  with  slope  and 
Intercept. 

4. 

Initial  Level  x  other  factor(s) 

. 

using  curve  fitting  procedures. 

Attribute 

Sessions  •  6,  540  trials/sessions. 

1. 

Initial  Level  x  other  factor(s) 

Comparison: 

Type  of  Match  Required  (Physical, 

using  curve  fitting  procedures. 

Decide  If 

Normal,  Categorical) 

two  sets  of 

Each  type  of  match  as  45  trials/ 

Items  match 

sessions. 

Quantitative 

Sessions  -  4,  128  or  144  problems/ 

1. 

For  addition,  fits  RT  slope 

Fact  Retrieval: 

session.  Each  session  tests  a 

across  the  different  sums. 

Arithmetic 

different  type  of  arithmetic 

2. 

Initial  Level  x  other  Factor(s) 

Operations 

operation. 

3. 

using  curve  fitting  procedures. 
Detailed  analysis  of  error  data. 

>:»1 


sa 
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Initial  ability  could  also  be  defined  by  a  classical  psychometrically- 
oriented  measure  or  by  a  criterion  task  correlated  with  the  automaticity 
task  of  interest.  Two  relevant  questions  emerge: 

(a)  how  does  performance  on  the  correlated  measure  interact  with 
initial  performance  on  the  automaticity  task; 

(b)  how  does  psychometric  ability  or  criterion  task  performance 
interact  with  practice  on  the  automaticity  task? 

These  questions  could  be  answered  by  a  split-plot  repeated  measures 
analysis,  with  the  Group  variable  derived  by  stratification  of  a  psycho¬ 
metric  correlate.  For  example,  assuming  that  a  Perceptual  Speed  measure 
(developed  according  to  classical  psychometric  procedures)  predicts 
performance  for  this  task,  one  can  determine  how  high  and  low  ability 
subjects  on  this  psychometric  measure  differ  in  their  respective  learning 
rates  for  Perceptual  Matching  (1). 

Another  strategy  could  include  systematic  variation  in  the  introduction 
of  the  psychometric  and  criterion  task  measures  at  different  stages  of 
practice  on  the  automaticity  task.  For  example,  one  can  systematically 
introduce  a  measure  of  Perceptual  Speed  or  a  related  criterion  task,  perhaps 
one  requiring  target  detection,  in  one  or  more  of  the  eight  sessions  of  the 
Perceptual  Matching  Task.  The  goal  is  to  observe  how  well  increased 
competency  on  automaticity  of  the  Perceptual  Matching  transfers  to 
performance  in  a  psychometrically-based  ability  or  criterion  measure. 

In-House  Experiments  and  Updating  of  Some  Tests 


Table  5  is  a  concatenation  of  Christal 's  listing  of  Air  Force  experi¬ 
ments  performed  in-house  and  the  limited  listing  of  the  updating  of  in- 
house  and  other  tasks  (Christal,  1984,  1985).  Brief  discussions  of  each 
grouping  of  tasks,  (e.g.,  Triad  Sub-Battery)  follow. 

The  Triad  Sub-Battery  employs  a  paradigm  in  which  all  the  information 
for  a  trial  is  presented  simultaneously.  A  primary  focus  is  the  variation 
of  cognitive  and  linguistic  complexity  within  the  context  of  a  binary 
classification  RT  task. 


The  Speed  Level  Battery  measures  speed  and  level  scores  in  the  reason¬ 
ing,  quantitative  and  verbal  domains.  This  battery  contains  a  number  of 
tasks  employed  in  the  Baseline  Measures  Program  (Christal,  1984).  The  Speed 
Level  taskB  that  overlap  with  that  program  include  simple  and  choice  RT 
(9,10),  Sunday-Tuesday  Addition  (14),  Sentence  Picture  Verification  (15), 
and  Number  Facts  (16).  The  only  difference  between  the  Baseline  Measures 
and  the  Speed  Level  Battery  appears  to  be  the  number  of  trial  blocks  and  the 
number  of  trials  per  block  (see  Table  2  for  comparison). 


Table  $ 


Air  fort*  In-House  Tests 


Tut 

CitHtry 


Tilt  Hut  iK 
Description 


Task  Statistic 

Design  Of  ! start tt 


Triad  Tkrta  stimuli  pnsastsd  simultaneously 

Sab-Rettery  Is  Triangular  format,  with  aaa  of  tka 

kottoa  2  stimuli  aatcklag  tka  top  stimulus. 


1.  Simple  ST  -  Respond  to  aoy  llgkt 
oo  tko  scrota. 


I.  Ckolca  ST  -  dross  rtspooss  kay  aadsr 
tka  star,  which  occurs  randomly  on 
tka  loft  o?  right  aids. 


Spaad  level-(19S4) 
Massura  Spaad  and 
level  scorts  In 
tka  raasonlng. 
quant native, 
aortal  domains. 


3.  Physical  Idontlty: 

CUT 

CUT  SIT 

4.  Mata  Identity: 

RET 

Mt  ftt 

S.  Category  Identity: 

HARP 

CAN  P1AR0 

4.  Meaning  Identity: 

RESPITE 

REVERSE  REST 

1.  Sound  Identity: 

SLE1SH 

SLY  SLAY 

4.  Relation  Identity: 

I1RD-FLY 

SNAKE- SLITHER  CAT. 

t.  Staple  AT 

10.  Choice  RT 

11.  Retota  Analogies: 

Verbal  anologles 

12.  Muober  Sets:  Select  the  atypical 

auaber  series. 

13.  Fact  Verification; 

Detertlne 

whether  a  slap  la  santanca  ass  trua  or  falsa. 


I«.  Sunday-Tuasday  Addition;  Parfora 

syaboMc  srltkoatlc  with  Monday  •  1  and 
Sunday  •  2.  Answers  art  days  of  tka  task 
not  auatars. 

1$.  Sentence-Picture  Varlf Icstlon:  Ootaralna 
truth  or  falsity  of  slapla  saatancsi  Ilka 
tka  following: 

A  I 

Tko  A  Is  act  followed  by  tka  0. 


Hocks  •  S 
to  Trials 
IS  Trials 


N  Trials 

Hocks  •  1,  24  Trials/Hock 
Saataaca  typos 

Noun  with  ckaractsrlstlc 
teas  la  a  catogory 

SS  Trials 


Hocks  •  4,  It  trlals/Hocks 
Dtslga:  *To  Follow*  »s  *To  Precede* 
Active  as.  Passive 
Positive  vs.  Negative 
A  first  vs.  I  first 


It.  Dumber  facts:  A  saparata  block  for  tack  -  Hocks  •  t,  IS- 16  Trtals/Hock 

addition,  subtraction,  as  Implication, 
division,  tlsod. 


Table  I  (Continued) 


Air  Foret  In-Mome  Tests 


Task 

Task  Naas  and 

Task 

Statistic 

Category 

Description 

Design 

Of  Interest 

17.  Heaory  Identity:  Sm  Meaning  Identity  In  Block!  •  J,  28  Trials/Block 

Trial  Sub-battery. 

IS.  Sit  la  Systolic  AM  than  tic:  71  Trial! 

41ven  A  •  4,  •  •  J,  C  •  5.  C-l  ■  t 

1*.  Coaplex  Symbolic  Arlthaetlc:  IS  Trial! 

Slven  C  •  1/2,  I  •  23-17,  ■  A  •  I 

M-  CVC  -  Word  Pairs:  Henorlte  14  aiaoclatloa!  28  Trial!, 

between  tflgraas  and  couaon  aount  and  cheoid  Nouns  (aoderately  aaay, 
lynonya  of  tha  noun  aaioclatad  with  a  trlgraa.  aoderately  difficult) 

21.  Arttftaatlc  Tracking:  Perform  ill  successive 

arltnaattc  oparatlons.  Block!  •  2,  20  Trlali/Block 

22.  Heaory  Span:  Daclda  If  luccaiilvaly  graiantad  Blocks  •  3,  10  Trlali/Block 

suggastad  contiguous  numbers  were  prasant  and  Naaory  Load  Blockad  (S,  7,  9 

contiguous  in  a  prior  sat,  nuabars).  Nuaber  of  auabars 

taitad  (2  to  5). 

Blocks  •  3,  7  1 tans /Block. 

Variations: 

1.  asrkadnass  (tallar,  shorter 

2.  negation  In  first  vs. 
second  clausa. 

3.  congruence  In  relational 
adjective  la  tha  clausa  vs. 
la  tke  question. 

24.  Trait  levels:  Associate  a  trait  with  a  7  Itens;  S  paired  coaparlson/ltea 

latter,  e.g.,  A  •  fast,  B  •  slow,  C  •  aadlua 

and  2  letters  at  a  tine  on  that  trait. 

25.  Rule  Application:  Based  on  rules,  transfers 
first  2  letters  In  a  string  and  transfora 

that  result  with  tha  nest  latter,  ate.  Blocks  •  6,  10  Itess/Blocks 

24.  Revised  ABC  Test:  Associate  3  letters  to  Processing  Load  (0,1,2  oparatlons). 

their  respective  nuaerlc  operations  of  Tine  In  Heaory  deteralned  by 

varying  difficulty.  presentation  order  (1st,  2nd,  3rd) 

x  Tost  order  (1st,  2nd,  3rd). 

27.  Pipit  Span  with  Partial  Recell:  Neaorlie  Equal  nuaber  of  trials  for  prlaacy, 

sequential  order  of  (  digits.  recently  and  central  affects. 

28.  Hissing  Digit:  Decide  which  digit  Is  Biasing.  Heaory  load  (4,  4,  12) 

79 .  Past  Running  Recill:  Heaorlze  digits  of  Presentation  Rate  (4  or  4  digits 

variable  length  and  repeat  the  last  three  per  second).  Digit  Length 

digits  presented.  (4,  8,  12,  14  nuabars) 

30.  Letter-Digit:  Clven  a  list  of  digits  and  Blocks  •  3,  20  trials/Block  List  Change  In  aadlan 

associated  letters  continuously  appearing.  Length  (3,  4,  B,  digit-letter  response  tlae  over 

aatch  the  nuaber  to  Its  latter.  associations).  20  trials 

31.  Brown-Peterson  s:  Manor  lie  4  digits;  respond  Nuaber  of  Intervening  questions 
to  varying  nuaber  of  questions  regarding  a  (4,  4,  14) 

visual  display;  recall  original  digit  sequence. 


working  Heaory 
Battery-Eve luete 
fixed  ettentlonal 
apace  shared  for 
ahort-tera  stor¬ 
age  and  execution 


23.  Three-Tora  Series:  Coapare  and  aaka  a  choice 
based  on  Inforaatlon  In  two  consecutive 
sentences. 


Table  S  (Contused) 


Air  fere*  In-House  Tt»t» 


Talk 

Category 


Teak  Haas  and 

Oe script Ion 


Spatial- 

Visualization 


Short-Tarn 
Naaory  Battery 


Verbal  Learning 


Statistic 
Of  Interest 


32.  Brown-Psterson  hi  Naaorlza  digits;  answer 
questions  regarding  the  relative  order  of  the 
digits;  recall  original  sequence. 


S3.  Word  Recognition  Threshold;  hecognlze  coaaon 
English  words. 

3«.  figure  Synthesis  Task:  Synthesize  line 
segaentajnd  decide  If  a  one  or  two  segaent 
pert  wet  contained  In  the  synthesized  figure. 

35.  fslaer-Floures  Pert-Whole  Verification  Task; 
Decide  If  lines  of  a  figure  were  contained 
In  a  prior  figure. 


36-39.  Standard  Tests-ldentlcal  Pictures,  Block 
Synthesis  fora  Board,  fiestslt  Coaptation. 

40a, b.  Heaory  end  Visual  Search;  Decide  whether 
a  probe  Is  present  or  absent. 


41.  Peterson  end  Peterson  Task  with  Subtraction 
as  the  Intervening  task:  Heaorlze  a  con¬ 
sonant  trlgraa;  Subtract  a  consonant  Iterat 
Ively  froa  e  given  nuaber;  recall  trlgrea. 


42.  Iconic  Heaory:  Bacall  the  proapted  consonant 
In  a  2x8  aatrlx  of  consonants  exposed  for 
SO  (asec.). 


43.  Perceptual  Threshold;  Identify  stlaull  pre¬ 
sented  for  brief  exposure. 


44.  Paired-Associates  Learning  with  laaoery 
SrsteaatlcaUr  Varied:  learn  10  word  pairs 
for  each  trial.  Answer  10  aultlple  choice 
questions  testing  aeaory  for  word  pairs,  with 
only  the  first  end  lest  letters  of  the 
associated  word  end  dlstrsctors  appearing. 


4$.  Analogical  kessonlno  with  Slap  la  Bacall; 

Peasant  analogy  to  be  coapleted  based  on  prior 
analogy.  After  20  trials,  proapt  £  to 
reaeaber  one  ef  the  prior  analogies. 


Heaory  Load  (3  vs.  B  digits) 
Linguistic  difficulty;  e.g.,  B 
does  not  coae  before  3  vs.  B 
coaes  before  3. 

Word  Length  (3  vs.  4  letters) 
Exposure  tlae  (17,  33,  SO  asec.) 

Blocks  •  4,  24  trlels/Block 
Busbar  of  line  segaents  (3,  4, 

5,  6). 

96  Iteas 
Between  Is 

(Self  paTed  study  tlae  of  first 
figure  vs.  S00  asec.  study  tlae 
vs.  3000  asec.  study  tlae) 
6oodness  of  fora  (closure  and 
proxlalty  values  of  lines. 


Heaory  Search  -  Heaory  Load 
1,  2,  3,  4,  S  consonants). 
Visual  Search-Display  Load 
(1,  2,  3,  4  consonants). 


BT  slope  regressed  on 
aeaory;  aeaory  load  and 
display  load;  RT 
y- Intercepts  froa 
regression 


With  St  (2,  4.  6.  B.  12 
Interatlons).  Between  £s: 
Heanlngfulness  (Word  vs.  trlgraa) 
Difficulty  (Subtract  3  vs.  subtract 
*). 

Tlae  between  Hatrlx  disappearance 
end  proapt  (SO.  100,  ISO  asec.). 

Tlae  between  proapt  end  aatrlx 
appearance  (0,  $0,  100  asec.). 

Trials  •  ISO 

Exposurs  Tlae  (17,  33,  SO  asec.) 

Type  ef  stlaull  (upper  and  lewer  case 
letters  digits).  Stlaulus  length 
(Single  vs.  double  digits,  3  vs.  4 
letter  words). 

Trials  •  12;  10  quest lons/tr tel. 

Within  £s:  Iaagery  of  pairs  (low, 
aedlua,  high)  Trials  (4  trlels/laegery 
level)  Between  Ss:  Type  of  training 
(Bo  training  vs.  seasntlc  elaboration 
on  lest  6  trials  vs.  repetition  on 
last  trials). 

BT  for  A:  B  end  for  C:_. 
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Table  S  (CoattMiad) 

Air  force  In-House  Tests 


Talk 

Category 


Taak  Naaa  and 

Da script Ion 


Taak 

Dailgii 


Statistic 
Of  Interact 


miscellaneous 

(1M4) 


4*.  Salf-pasad  Paired  Associates  Laarnlnc;  Think 
of  a  sentence  to  connect  a  word-pair;  recall 
the  sentence  when  presented  with  half  of  the 
word  pair. 


47. 


Numerical  Operations;  Coaputerlted  version 
of  test  used  by  the  Air  Force  In  the  1950' a. 


Heaorv  for  lists  In  Different  Statlal 
Arrangements:  Heaorlte  12- Item  list. 


49.  Alphanunerlc  Series  Hatching:  Decide  If 
two  side-by-side  letter  strings  art  saae 
or  different. 

50 .  Picture  Paired  Associates  Uarnlno; 

Heaorlte  10  picture  pairs  and  select  the 
correct  associate  In  a  wimple  choice  format. 

51.  Nonsense-Picture  Paired  Associates:  Seat 
as  above,  but  nonsense  picture  used. 

52.  Trloraa  Paired  Assocletes  learn Inn:  Sana 
as  picture  pair,  but  manipulate 
meanlngfulness. 

53.  Word  Paired  Associates  Learning:  Set  #50. 

5«.  Neadlno  Nate:  Read  and  aeaorlze  comprehen¬ 
sion  of  six  sentences  presented  one  at  a 
ties. 


Trials  •  35.  Array  Arrangeaent 
(Clock-like,  ladder,  step-like). 
Structure  of  Prompt  (Pictorial,  l.e., 
lists's  structure  maintained  except 
for  blank  to  be  recalled  stlaulus  vs. 
verbal,  l.e.,  ’Recall  what  Itea  fell 
In  a  given  position  number*). 


Trials  •  72. 
Display  Load  (a. 


9  characters) 


Sett  •  1;  10  palrt/tet 


Sett  •  6,  10  pelrs/set 
Htenlngfulnett  (3  high  vs.  3  low 
meaningful  sets  of  trlgraas) 


Passages  •  (,  1-10  quest lons/passtge. 


55.  free  Recall;  Heaorlte  70  words  for  each  of  Categories  •  10 

10  categories.  Ron-referenced  word  frequency  (high, 

median,  low). 

Trials  •  45;  Set  Naalpulatlon  (Test 
object  presented  for  aaaory  vs.  test 
object  not  presented  but  set  member  of 
object  vs.  test  object  not  presented). 

52-  Heaory  for  Digit  Order;  Decide  If  suggested  Trials  •  (0. 

7-strlng  digit  It  In  the  teat  order  at  a  Order  manipulation  (Mat  order  vs. 

prior  string.  transposition  of  adjacent  digits). 

Exposure  Time  (It. 2,  33,  SO  msec.) 

Type  of  stlaull  (upper  end  lower 
case  letters,  digits)  stlaulus 
length  (single  vs.  double  digits,  3 
vs.  t  letter  words). 


5a.  Perceptual  Threshold:  Identify  stlaull  pre- 
tented  for  brief  exposure. 
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The  Working  Memory  Battery  contains  tasks  requiring  continual  updating 
of  information  (27,29,30),  arithmetic  operations  (26),  memory  of  a  large 
number  of  stimuli  (27,28),  memory  with  intervening  interference  tasks  (31, 
32)  and  perceptual  recognition  (33).  These  tasks  appear  to  require  in¬ 
creased  effort  as  defined  by  the  magnitude  of  the  number  of  stimuli  on  which 
the  subject  operates. 

Spatial  Visualization  tasks  appear  to  require  updating  and  integration 
of  past  and  present  information  (34,35).  This  battery  also  contains  a 
number  of  standardized  tests  (36-39). 

The  Short-Term  Memory  Battery  contains  the  Sternberg  task  with  varia¬ 
tions  of  memory  load  (40a)  and  display  load  (40b).  The  tasks  also  represent 
various  stages  of  visual  memory  (43, 42, 40a ,40b)  and  a  paired  associates  task 
with  an  extra  retehtion  component  (41).  These  tasks  do  not  appear  to 
concentrate  on  difficult  stimulus  parameters  as  found  for  the  Working  Memory 
Battery.  One  may  posit  that  the  Short-Term  Memory  Battery  is  designed  to 
capture  various  search  behaviors  while  the  Working  Memory  Battery  is 
designed  to  capture  recursive  behaviors  and/or  behaviors  requiring  increased 
effort. 

The  Verbal  Learning  Battery  employs  paired-associate  tasks  with 
embedded  independent  variables  (44)  and  an  analogical  reasoning  task 
popularized  by  Robert  Sternberg  (45). 

The  Miscellaneous  Tasks  include  various  speed  level  tasks  (47,48,49), 
paired-associates  tasks  (50-53,55,56),  comprehension  (54),  serial  order 
memory  (57)  and  perceptual  threshold  (58). 

The  tasks  listed  in  Table  5,  like  those  in  Table  2,  contain  more  trials 
per  task  condition  than  do  Project  A  tasks.  Table  5  does  not  contain 
reliability  information  as  reported  in  Table  2.  There  is  overlap  in  the 
content  of  the  tasks  listed  in  Tables  5  (Air  Force  in-hou6e  tests)  and  Table 
2  (Air  Force  Baseline  Tasks). 

NAVAL  SPATIAL  ABILITY  TESTS 

Table  6  tasks  are  being  developed  by  the  Navy  (Christal,  1984,  1985). 
These  tasks  are  included  in  the  present  review  because  of  their  emphasis  on 
spatial  abilities,  a  primary  focus  of  Project  A  measures.  The  Navy’s  tasks 
are  categorized  as  those  involving  static  displays,  displays  with  moving 
elements  and  spatial  orientation. 

The  static  displays  include  the  Shepard  Mental  Rotation  task  (2)  and 
SAME-DIFFERENT  judgment  task  of  complex  and  perturbed  stimuli  (Cooper,  1976; 
1980).  Also  included  are  tasks  (3, 4, 5, 6)  that  capture  different  aspects  of 
Kosslyn's  theory  of  mental  imagery  (Kosslyn,  1981). 

The  moving  display  tasks  appear  to  stress  the  ability  to  identify  and 
anticipate  intersection  points  of  a  trajectory  (7,8,9). 
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Tania  « 

Naval  Spatial  Ability  Tasks 


Task  Category  Tttk  Iim  and  Description 


Task  Design 


Statistic  of  latorott 


Tasks  1  avowing 
Static  Displays 


Tasts  Involving 
Moving  Elnnants 


Spatial 
Or  lantat Ion 


1.  figure!  Coooarlson:  Doc  10*  If  too 
slnulteneously  prosantad  polygons 
ora  the  soon  or  dlfforoat  ( 1 .a . . 
Parcaptaal  Spend). 

2.  Manta  1  notation;  One 10a  If  two 
slavttaaeouily  prosootad  polygons 
art  thenaaa  or  dlfforoat. 

J.  Adding  Patall  to  an  loaaa:  Ot larva 
a  shape  rapaatadly,  with  sack  pro- 
santatlon  containing  the  shape  and 
I  additional  detail.  Decide  In 
■ultlpla  choice  forest  which  shape 
contains  all  the  details. 

4.  fora  Board 


5.  Inapt  Integration:  Mentally  Inte¬ 
grate  array  of  Irregular  shapes  and 
then  decide  In  oultlpla  choice 
foraat  the  correct  shape. 

«.  Surface  Dave loonent :  Decide  If, 
e.g.,  2  edges  of  a  flat  enfolded 
cube  nould  fold  Into  on  Identical 
cube  at  a  previously  presented 
unfolded  cube. 

7.  One  Moving  Elenent;  Decide  the 
intercept  point  of  a  trajectory 
or  Mhan  the  trajectory  Mill  roach 
a  point  or_  both. 

I.  Imp  Moving  Eleeenti:  Trajectory 
paradlga  as  17. 


9 .  Pseudo  driver  Displays ■  J-6 

perspective  (or  trajectorj  test 


10.  tooorsphic  Orientation:  S Insisted 
route  learning  task  in  Mhlch  £s  are 
thovn  e  changing  display  represent¬ 
ing  aoveoent  through  an  envlronnent. 

11.  Spatial  Orientation:  freo  within  a 
Hindoo  lets  rooo  In  a  fanlller 
setting  (l.e..  college  caapus)  per- 
f ora  different  tasks. 

12.  Meoory  for  Position:  Decide  if  a 
sequence  of  lights  on  a  1*1  grid 
mss  presented  previously. 

II.  lndlcstlon  of  locstlon  of  novtno 
Oh  led  :  Decide  beer  lag  of  JO 
object  after  It  novas  off  the 
screen.  Decide  tine  JO  object 
would  be  alongside  self. 

14.  Deographlc  Orientation:  Drew  asp 
or  sloulated  envlronnent. 


Trials  •  120;  240  Coaplestty  (No. 
geonatrlc  points)  Parturbatlon 
( Extent  of  difference) 

Trials  •  200;  Aagelsr  disparity 
(0-140°)  Natch  Type  (Sane  or 
Olfforant). 

Trials  -  J2-40;  Dunbar  of  succes¬ 
sive  presentations  (J  to  t). 


Average  NT,  Errors 


NT  slope  regressed  across 
angularity.  Intercept  of 
RT.  Separate  Slope  and 
Intercept  for  aach  Decision. 


Trials  •  240,  Vary:  1.  Do.  of 
Stlaulus  Elnnants.  2.  Manipulation 
of  Elenants  for  Asssnbllng. 

Trials  •  20  to  JO; 

Nunber  of  Shapes  (2  to  6). 


RT  estlaates  for  notor  tine, 
encoding  and  coapertson  tine, 
search  tine.  Rotation  Rate, 
Accuracy. 

Tine  to  perfora  Integration. 
Tine  to  doc  Ida  correct  shape. 
Accuracy. 


Trials  *  Jt  to  RO;  No.  of  Manipulated  Tine  to  nentally  fold  first 
surfaces  (1  to  t).  first  cube.  Tine  to  decide 

natch.  Accuracy. 


Tsry: 

1.  Type  of  trajectory  (straight  vs. 
curved) 

2.  Angle  of  intersection 
J.  Speed  end  acceleration 

4.  intent  of  nation  extrapolation 
Rory: 

1.  See  Two  Moving  Elenants  (PR) 

2 .  Subject's  SO  perspective  of 
novlng  objects 

Rary; 

1.  Envlronnent  coaplsxtty 
I.  Changes  In  Direction 
I.  Distance  traveled 
Tasks: 

I.  Point  to  college  tandaerk 
i.  Nark  direction  on  paper 

J.  Draw  a  caapus  nap 
Nenory  Load  (2.  J,  or  4 
lights  In  soguence) 


Accuracy  of  pointing 


Set  Task  #10. 


Accuracy  of  nap 
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The  table  aleo  Includes  tasks  that  appear  to  stress  a  subject's  ability 
to  place  himself /herself  in  a  static  or  moving  environment  (10,11,13,14). 
Tasks  employing  this  ability  but  adapting  it  to  *real  world*  environmental 
cues  are  included  (10,14)  as  are  tasks  dealing  with  updating  analog  informa¬ 
tion  (12,13).  A  criterion  task  of  orientation  ability  contains  subtasks  of 
orienting  oneself  in  a  familiar  environment  by  pointing  to  directions  of 
well-known  features  and  drawing  a  map  that  contains  those  features  (11). 

The  tasks  listed  in  Table  6  were  selected  and  developed  under  contract 
with  Earl  Hunt  and  J.  V.  Pellegrino. 

ARMY'S  PROJECT  A  PREDICTOR  BATTERY 

The  Project  A  predictor  battery  is  designed  to  be  an  expansion  of  the 
number  of  construcfs  that  may  be  used  as  predictors  to  select  and  classify 
Army  recruits  into  different  military  occupational  specialties  (Peterson, 
1985).  A  brief  description  of  Project  A  measures  and  the  role  that  the 
developing  cognitive  and  psychomotor  measures  play  in  the  project  was 
presented  in  the  present  report’s  Introduction  section.  The  report  will  now 
describe  those  measures. 

Table  7  contains  the  Project  A  computer  and  paper-and-pencil  tests. 

The  tests  represent  some  of  the  hypothesised  dimensions  of  primary  impor¬ 
tance  for  performance  in  the  Army  and  are  designed  to  discriminate  reliably 
among  the  ability  levels  of  those  recruits  now  entering  the  Army.  The 
reader  is  referred  to  Eaton  et  al.  (1985)  or  Peterson  (1985)  for  further 
discussion  of  Project  A  predictors  on  topics  not  included  in  the  present 
report. 

Some  of  the  tests  listed  are  not  currently  considered  as  necessary  as 
they  once  were.  Necessity  may  be  determined  by  construct  uniqueness  and 
fitting  test  administration  constraints.  For  example,  the  Shapes  Test  which 
is  designed  to  measure  field  dependence  is  not  currently  being  considered  as 
part  of  the  battery.  Support  for  this  decision  may  be  found  in  the  factor 
analytic  studies  showing  that  field  dependence  and  tests  similar  to  Assemble 
Objects,  another  test  in  the  Project  A  battery,  consistently  load  on  the 
tame  factor  (Mos,  Wardell,  fc  Royce,  1974).  The  purpose  of  including  the 
Shapes  Test  and  other  tests  not  currently  part  of  the  battery  is  to  maximize 
possible  comparisons  between  Project  A  developed  tests  and  the  tests 
developed  by  the  other  services.  Other  tests  no  longer  in  the  battery 
include  the  Path,  Reasoning  2  and  Orientation  1  Tests.  The  Orientation  3 
Test  is  currently  called  the  Map  Test. 

Comparisons  Between  Project  A  Tests  and  Air  Force  and  Navy  Tests 

A  primary  purpose  of  this  report  is  captured  by  this  section.  The 
section  contains  tables  that  cross-reference  Project  A  tests  with  the  Air 
Force  and  Navy  tests  reviewed  earlier  in  the  report.  Tables  8,  9,  10,  11, 
and  12  represent  a  'cross-matrix*  of  the  Project  A  tests  with  the  AFHRL 
programs  of  1984  and  1985  and  the  Navy’s  1985  program. 
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Table  7 


a 


iii-g/ivin 


Construct  and 

Task  Non 


A  Cognitive  and 


ter  Predictor  Batte 


Task  Description 


Spatial  Visualization  Rotation 

1.  Assembling  Decide  hou  an  object  looks  when 
Objects  parts  are  put  back  together. 


Design 


Statistic  of  Interest 


2.  Object 
Rotation 


Decide  whether  two  figures 
are  the  SAME  or  DIFFERENT. 


Field  Independence 
3.  Shapes  I 


Scanning 

4.  Path 

5.  Nazes 


Decide  which  staple  figure  Is 
embedded  In  a  more  corap lex  figure. 


Decide  which  of  a  given  number 
of  defined  paths  is  the 
shortest  between  2  points. 

Decide  tftich  naze  entrance 
passes  through  the  naze  and  to 
one  of  Its  exit  points. 


Items  -  40;  %  Correct 

Label  (Label  contiguous 
parts  vs.  don't  label 
contiguous  parts) 

Items  •  90;  Orientation  %  Correct 

(Rotation  vs.  FI ipped  Over) 


Items  -  54  %  Correct 


Items  -  44  %  Correct 


Items  *  24  %  Correct 


£ 

V 

Induction 

s 

6. 

Reasoning  1 

Identify  pattern  among  figures 
and  decide  next  figure  In  series. 

Items  -  30 

%  Correct 

i 

7. 

Reasoning  2 

Identify  the  anomalous  figure. 

Items  -  32 

%  Correct 

£ 

Spi 

itlal  Orientation 

8. 

Orientation 

Given  a  circle  with  a  labeled 

Items  *  150;  5  Items/set 

%  Correct 

.v 

1 

North  heading,  decide  which  of 

5  other  heading-labelled  circles 

ft 

are  reoriented  consistently. 

|L 

9. 

Orientation 

Rental ly  rotate  a  frame  around  to 

Items  •  20 

%  Correct 

2 

the  bottom  of  a  scene,  and  decide 
what  the  orientation  of  a  feature 

In  the  frame  would  be. 

ft 

10, 

.  Orientation 

Given  the  direction  of  a  land¬ 

Items  ■  24 

%  Correct 

£ 

3 

mark,  decide  the  direction  of 

travel  to  other  lantaarks. 


11.  Staple 
Reaction  Time 

12.  Unice 
Reaction  Time 


Trial  -  10 


Trial  -  30 


J,  S.D..  %  Errors 


J.  S.D.,  %  Errors 


Table  7  (Continued) 


The  Army's  Project  A  Cognitive  and  Conouter  Predictor  Battei 


Construct  and 

Task  Name 

Task  Description 

Design 

Statistic  of  Interest 

13.  Perceptual  Speed 
and  Accuracy 

Decide  If  two  stimulus 
arrays  match. 

Trial  •  36;  (alpha, 
nunerlc,  symbolic)  x 

3  (2,5,9  Characters) 
x  2  (SAME  vs.  DIFFERENT 
Judgments). 

7,  S.D.,  Slope 
Intercept,  *  Errors 

14.  Target  Identity 

Natch  a  military  vehicle  or 
aircraft  target  to  one  of 

3  possible  targets. 

Trial  ■  36,  Agularlty  x 
Dfscrlmlnabllity 

7.  S.D.,  Slope 
Intercept,  %  Errors 

15.  Short-Term 

Memory 

Sternberg  Memory  Scanning 

Task 

Trial  -  36;  3  (1,3,5 
memory  load)  x  2 
(letters  vs.  symbols) 
x  2  (Presence  vs. 

Absence  Judgments) 

7,  S.D.,  Slope 
Intercept,  %  Errors 

16.  Number  Memory 

Continually  perform  numer¬ 
ical  operations  on  a  sequent¬ 
ially  presented  set  of 
numbers. 

Trial  -  26  or  18 

7,  S.D.,  Slope 
Intercept,  %  Errors 

17.  Cannon  Shoot 

Rendezvous  with  a  target  by 
firing  a  shell  from  a 
stationary  position. 

Trial  -  36;  4  (Right, 

Down,  Left,  Up  Direction 
to  fire) 

7  Time,  X  Log 
(distance  +1)  Error 

Psvchomotor  Tests 

18.  Target  Track  1 

Rendezvous  with  and  remain  on 
top  of  a  target  moving  along 
a  marked  path  by  moving  a 
joystick. 

Trial  -  18.  3  (max.  cross¬ 
hair  speed)  x  3  (Differ¬ 
ence  btwn  Speed  of  Target 
and  Max.  Crosshair  Speed) 
x  3  (No.  of  turns  In  path) 

7  log  (distance  +1 
errors 

19.  Target  Track  2 

Rendezvous  with  and  remain  on 
top  of  a  target  moving  along 
a  marked  path  by  moving  a 
horizontal  and  a  vertical 
slide. 

Trial  -  18,  3  (Max.  cross¬ 
hair  speed)  x  3  (Differ¬ 
ence  btwn  Speed  of  Target 
and  Max.  Crosshair  Speed) 
x  3  (No.  of  turns  In  path) 

20.  Target  Shoot 

Rendezvous  with  a  target  that 
Is  unpredictably  changing 
directions  by  moving  a  joy¬ 
stick  and  pressing  a  button 
to  fire. 

Trial  ■  30,  Speed  of  Target 
x  Max  Speed  of  Crosshair 
x  Mean  Length  of  each  Seg¬ 
ment  traversed  by  the 
target. 

7  Time  to  fire 
Percent  Hits 

Mote.  Reaction  time  data  are  broken  down  Into  Decision,  Movement  and  Total  Time. 


Reaction  time  data  are  presented  in  both  raw  form  and  by  log  transformation,  with  the  fastest  and 
slowest  RT  tr limed  off  for  each  stage. 

The  Independent  variable  information  Is  taken  from  McHenry  t  McCue  (1985)  and  Toquam,  et.  al.  (1985). 


Mr  Force  and  Raw  T««t»  Stellar  Prelect  A  Reasoning  and  Spatial  Orientation  Tests 


Inductive  Reasoning  Spatial  Orlantat Ion 

Table  Table 

Ruaber  grouping _ 1 _ 2 _ 1  *  J 


Air  Fare*: 


1 

I.A.T. 

Mental  Rotation  (6) 

1 

Baseline 

Last  Letter  of 

Patterns  of  Letter 

Rotated  Figures  (25)  Rotated  Figures  (25) 

Pattern  (20); 

Series  (IB);  Three 

Three  Ters 

Tara  Series  (16) 

Series  (16) 

3 

Learn 

. 

Tine  Check  (partly) 

Direction  Judgaent(6) 

Curva 

- 

(3) 

4 

Autosatlclty 

s 

Speed 

Three  Tara 

Muaber  Sets  (16); 

Level 

Series  (23) 

Three  Tara  Series  (23) 

5 

Miscellaneous 

Meaory  for  lists 

In  different  spat¬ 

ial  arrangeaents(4<) 

S 

Verbal 

Analogical 

Learning 

Reasoning  (45) 

s 

TRIAD 

Relational 

Identity  (6) 

5 

S.T.M. 

• 

5  Working  Heaory 
S  Spit.  VIS. 

Nivy: 


6  Sutlc  Displays  Mtntil  Rotation  (2)  Mental  Rotation  (2) 

6  Moving  Displays 

6  Spatial  Orlant.  Pseudo  Drlrar  (g)  Pseudo  Driver  (9)  Spatial  Orlant,  (11) 

Indicate  Location  of  Indlcatt  Location  geographic  Orlant. 
Moving  Targat  (13)  of  Moving  Targat  (13)  (10) 


Rota.  6.A.T.  •  Basle  Attributes  Test  Prograa;  Laarn  Curve  •  Tests  Designed  to  capture  learning  paraaeters;  TRIAD  *  tests  la  which 
standard  stlsulus  and  the  two  choices  fors  a  triangle;  S.T.M.  •  Short-Tare  Meeory;  Spat.  91s.  •  Spatial  Visualization; 

Spat.  Orient.  •  Spatial  Orientation. 


Tit  le  10 


V 

14 


»• 

> 

> 

8 

t 


Air  Foret  tad  Mvy  Ttiti  stellar  to  Project  A  Unction  Tit  and  Perceptual  Steed  and  Accuracy  Tuti 


Reaction  Tin 

Perceptual  Speed  1  Accuracy  (PStA) 

Tibia 

Buber 

(rouping 

Slip la 

Choice 

PSRA 

Target  Identity 

Air  Force: 

1 

8.A.T. 

Decision-Making 

Speed  (B)  (Partly) 

Encoding  Speed  (4) 

Mental  Rotation  (S) 

2 

Baseline 

Staple 

Choice 

Posner  Physical 

Rotated  Figures  (2S) 

*T(1) 

RT(2) 

Identity  (3) 

3 

Learn 

Curve 

4 

Autoaetlclty 

Attribute  Coaparlson  (2) 
Perceptual  Matching  (1) 

5 

Spaed 

Staple 

Choice 

Level 

RT  (9) 

RT  (10) 

5 

Miscellaneous 

Alphanumeric  Series 

Match  (49) 

5 

Verbal  Learning 
TRIAD 

Staple 

Choice 

Posner  Physical  1 

*T  (1) 

Rt  (2) 

Kane  Ident.  (3,  4) 

5 

s.t.m. 

5 

Working  Heiory 

5 

Spat.  Vis. 

Navy: 

e 

Static  Displays 

Figure  1  Coaparlson  (l) 

Flgural  Coaparlson  (1) 
Mental  Rotation  (2) 

6 

Moving  Displays 

6 

Spatial  Orient. 

Mote.  B.A.T.  •  Basic  Attributes  Tut  Prograa;  Learn  Curve  *  T*it»  designed  to  ctpturt  learning  parameters; 
TRIAD  •  Tests  In  which  standard  stlaulus  and  the  two  choices  fori  a  triangle;  S.T.M.  •  Shor’-Tera  Meaory; 
Spat.  vis.  •  Spatial  Visualization;  Spat.  Orient.  •  Spatial  Orientation. 
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Table  11 


1 


Air  Force  and  Navy  Tests  Similar  to  Project  A  Short-Term  Memory,  Nuaber  Memory  and  Movement  Judgment  T*$t$ 


Table  Table 

Nuaber  Croup Ing 


Movement  Judgment 


Nuaber  Heaory 


Cannon  Shoot 


B.A.T. 

Baseline 


Itea  Recognition  (6) 
Sternberg  No.  (7a), 
Moods  (7o); 

Visual  Scan  (21) 


Numerical  Operations  (B) 


Learn 

Curve 

Automat Iclty 


Strategic  Decision  (7) 


Hlscellaneoes 
Verbal  Learning 
TRIAD 
S.T.H. 


Quantitative  Fact 
Retrieval  (3) 

Arithmetic  Tracking  (21); 

Staple  Symbolic  Arithmetic  (IS); 

Nuaber  Facts  (16) 

Computerized  Numerical  Operations  (47) 


Heaory  b  Visual 
Search  (40a,  b) 


Working  Heaory 
Spat.  Vis. 


Revised  ABC  Test  (26) 


Static  Displays 
Moving  Displays 


One  Moving  Element  (7);  Two 
Moving  Elements  (6); 


Pseudo  Driver  Task  (9) 


Spatial  Orient.  Memory  for  Position  (2) 


Indicate  location  of  Moving 
Target  (13) 


Note.  B.A.T.  •  Basic  Attributes  Test  Program;  Learn  Curve  •  Tests  designed  to  cepture  learning  parameters; 
TRIAD*  Tests  In  which  standard  stimulus  and  the  two  choices  Torn  a  triangle;  S.T.H.  •  Short-Term  Memory; 
Spat.  vis.  •  spatial  Visualization;  Spat.  Orient.  •  Spatial  Orientation. 


Table  12 


Air  fore*  and  jwj  Teete  Similar  to  Project  A  Pjjchonotor  Taata 


Paychomotor 

Table  Table 

Humber  Crouplng 

Target  Track  1 

Target  Track  2 

Target  Shoot 

Air  force; 

* 

1 

B.A.T. 

Tima  Sharing  (3) 

Time  Sharing  (3) 
2-Band  Coordination 
(16) 

Time  Sharing  (3) 

2 

Baaellna 

3 

Learn 

Curva 

4 

Automatlcity 

5 

Speed 

Level 

3 

Mlecellaueoue 

3 

Verbal  Learning 

5 

TRIAD 

5 

S.T.M. 

5 

Working  Mamory 

3 

Spat.  Via. 

Navy; 

6 

Static  Diaplaye 

6 

Moving  Diaplaye 

Two  Moving  Objecta 

(«) 

Two  Moving  Objecta  (B) 

6 

Spatial  Orient. 

Hof .  B.A.T.  -  Baalc  Attribute*  Teat  Program;  Learn  Curve  -  Taata  daelgnad  to  capture  learning 
parametara;  TRIAD  -  Taata  In  vhich  atandard  atlmulua  and  the  two  cholcaa  form  a  triangle; 

S.T.M.  •  Short-Term  Memory;  Spat.  Via.  “  Spatial  Vleuallxatlon ;  Spat.  Orlant.  -  Spatial 
Orientation. 
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The  tables  list  the  names  of  the  programs  and  their  respective  tests 
which  appear  to  be  similar  to  Project  A  tests.  For  example,  the  Form  Board 
Test  of  the  Navy’s  Static  Display  Test  Battery  appears  analogous  to  Project 
A’s  Assemble  Objects  Test. 

Although  brief  explanations  for  the  suggested  overlaps  between  Project 
A  tests  and  the  Air  Force  and  Navy  tests  follow,  this  author  is  aware  of  the 
limited  reliability  of  this  'sorting*  task  with  an  n«l.  The  reader  may 
refer  to  Table  7  for  descriptions  of  the  Project  A  tests  and  Tables  1  to  6 
for  descriptions  of  the  other  tests  to  decide  whether  he /she  agrees  with  the 
proposed  overlaps /relationships  listed  in  Tables  8-12. 

The  reader  is  encouraged  to  perform  two  'search*  tasks  as  he/ahe  is 
reading  the  upcoming  text.  First,  he /she  may  look  at  the  relevant  'crossma¬ 
trix*  table  to  get-a  sense  of  the  other  tests  to  which  a  Project  A  test  is 
suggested  to  be  analogous.  Second,  the  reader  may  use  the  crossmatrix  table 
to  refer  to  the  table  number  in  which  the  task  suggested  to  be  analogous  to 
a  Project  A  test  is  described. 

For  example,  the  text  suggests  that  the  Image  Integration  Task  appears 
analogous  to  the  Project  A  Assemble  Objects  Tests.  Table  B  contains  the 
column  heading  'Assemble  Objects*  under  which  suggested  analogous  tasks  are 
listed.  Table  8  shows  that  one  suggested  analogous  test  to  Assemble 
Objects,  the  Image  Integration  Task,  is  part  of  the  Navy’s  Static  Display 
Battery  and  directs  the  reader  to  Table  6,  test  number  5,  to  obtain  more 
information  regarding  the  Image  Integration  Task.  The  text  just  prior  to 
Table  6  contains  a  brief  description  of  the  test  and  the  battery,  as  well. 
These  and  other  comparisons  between  each  Project  A  test  and  the  Air  Force 
and  Navy  tasks  follow. 

Assemble  Objects  (Table  8).  The  Form  Board  and  Image  Integration  Tests 
require  that  a  subject  put  together  parts  of  a  geometric  figure  to  form  that 
figure.  This  appears  to  be  directly  analogous  to  the  Project  A  Assemble 
Objects  Test,  except  that  Form  Board  and  Image  Integration  are  computer 
administered  while  Assemble  Objects  is  in  booklet  form. 

The  Figure  Synthesis  and  Ichakawa  tests  require  that  the  subject  inte¬ 
grate  the  successive  presentation  of  different  parts  of  a  figure  and  to 
assemble  the  parts  together  to  form  a  whole  figure. 


Object  Rotation  (Table  8)  and  Orientation  (Table  9)  Tasks.  Spatial 


tests  may  require  different  types  of  distinctions.  These  include  distingu¬ 


ishing  between: 


(a)  a  matching  figure  versus  its  mirror  image  (rotated  or 
unrotated) ; 

(b)  a  rotated  matching  figure  versus  its  mirror  image  or  a 
different  figure; 

(c)  a  matching  figure  versus  a  different  figure; 

(d)  a  amtching  trajectory  versus  a  different  trajectory. 


33 


The  Project  A  Object  Rotation  Task  requires  discrimination  between  a 
figure  and  its  mirror  image.  The  BAT's  Mental  Rotation  Task  also  contains 
trials  in  which  a  figure’s  mirror  image  is  rotated.  However,  this  Mental 
Rotation  Task  requires  that  the  subject  decide  that  a  mirror  image  is  a 
match,  while  Project  A’s  Object  Rotation  Test  requires  that  the  subject 
decide  that  a  mirror  image  is  a  mismatch.  The  other  tests  listed  under 
Object  Rotation  do  not  require  distinguishing  between  an  object  and  its 
mirror  image. 

The  Spatial  Orientation  task  requires  that  one  identify  the  correct 
orientation  of  an  object,  once  having  mentally  rotated  the  object  to  a 
prespecified  position. 

One  may  consider  identification  of  a  trajectory  as  a  component  of  a 
spatial  orientation  task.  For  example,  when  a  subject  is  deciding  how  an 
object  appears  when  it  is  rotated  one  may  argue  that  the  subject  is  at¬ 
tempting  to  identify  an  object  when  its  trajectory  comprises  its  swiveling, 
or  re-orienting,  on  itself.  In  other  words,  while  identifying  the  'swivel* 
trajectory,  the  subject  matches  up  parts  of  the  original  figure  with  the 
swiveled  figure.  Such  reasoning  suggests  that  the  Naval  Trajectory  Tasks 
(Indicate  Location  of  Moving  Target,  Pseudo  Driver)  could  relate  to  Spatial 
Orientation  tasks  and  that  a  ’swivel*  trajectory  identification  task  could 
relate  to  the  Object  Rotation  Test. 

Also  of  interest  are  two  analog  Air  Force  tasks,  Time  Check  and 
Direction  Judgment.  The  Direction  Judgment  Task  requires  that  one  remember 
the  spatial  positions  of  different  features  on  a  map,  which  is  similar  to 
Project  A's  Orientation  3  Task.  A  component  of  the  Time  Check  Task  requires 
that  one  determine  the  time  of  a  clock  face  that  has  been  rotated,  a  task 
similar  to  Project  A’s  Orientation  1  Task. 

One  possible  implication  of  these  Air  Force  tasks  is  that  one  can 
isolate  critical  parts  of  job  behaviors  and  use  those  components  as 
predictors  of  task  performance.  One  can  also  embed  experimentally 
manipulated  variables  within  components  of  a  criterion  task  that  is  composed 
of  job-relevant  behaviors.  For  example,  The  Memory  for  Lists  in  Different 
Spatial  Arrangements  Task  (see  Table  3)  requires  that  one  remember  the 
relative  position  of  various  features  within  a  geometric  figure.  The  task 
is  also  designed  to  assess  the  effect  of  visually-cued  information.  The 
visual  presentation  mode  is  represented  by  the  reintroduction  of  the  same 
figure  with  the  critical  feature  missing,  with  the  requirement  that  the 
subject  recall  the  missing  feature.  Alternatively,  the  subject  is  asked  in 
sentence  format  to  recall  the  feature  that  was  in  a  specific  position. 
Comparison  between  the  visually-cued  format  versus  the  sentence-format 
allows  for  study  of  the  regeneration  of  stimuli  via  the  visual  versus  verbal 
stimulus  modes. 

Field  Independence  (Table  8).  The  Project  A  Shapes  Test  is  designed  as 
an  analog  to  the  Hidden  Figures  Test,  a  measure  of  field  dependence.  The 
Air  Force  BAT  program  presents  two  complex  figures  and  requires  the  subject 
to  decide  which  of  the  two  figures  contains  a  specific  simple  figure.  Other 
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variations  of  field  dependent  measures  may  be  deciding  whether  line  segments 
are  embedded  within  a  previously  presented  figure  (Palmer  Figures)  or 
carefully  matching  two  similar  complex  figures  to  see  if  they  totally  match 
(Pigural  Comparison).  A  Form  Board  Test,  which  operationally  requires 
assembling  simple  objects  into  a  more  complex  object,  is  included  here 
because  Form  Board  Measures  typically  load  on  the  same  Factor  as  field 
independence  measures.  This  has  been  labeled  the  Flexibility  of  Closure 
Factor  (Mos,  et  al.). 

Scanning  Tasks  (Tables  8).  This  report  did  not  identify  analogs  of  the 
Project  A  scanning  tasks  in  -the  Air  Force  and  Naval  Programs  that  it 
reviewed . 

Inductive  Reasoning  (Table  9).  Inductive  Reasoning  may  require  iden¬ 
tification  of  an  anomalous  series  (Project  A’s  Reasoning  Test  2  or  other 
tests,  such  as  Patterns  in  Letter  Series  or  Number  Sets).  It  may  also 
require  identification  of  a  given  pattern  (Last  Letter  of  Pattern  Test  or 
Project  A’s  Reasoning  Test  1).  One  may  also  expect  relationships  between 
Reasoning  Test  1  with  Three  Term  Series,  Analogical  Reasoning  and  Relational 
Identity  Tests. 

Simple  and  Choice  Reaction  Time  (Table  10).  The  Project  A  simple  re¬ 
action  time  (SRT)  task  requires  that  the  subject  respond  to  the  presence  of 
a  stimulus;  the  task  appeals  analogous  to  other  SRT  tasks.  The  Project  A 
choice  reaction  time  (CRT)  task  requires  that  the  subject  make  one  response 
to  one  stimulus  and  another  response  to  another  stimulus.  The  Project  A  CRT 
task  contains  an  interval  between  the  initial  stimulus  and  the  stimulus  to 
which  the  subject  responds.  The  Air  Force  Triad  CRT  task  simultaneously 
presents  the  ■ initial  *  stimulus  with  the  two  choices  underneath,  with  all 
three  stimuli  forming  a  triangular  pattern.  The  subject  decides  which  of 
the  two  bottom  choices  matches  the  top  stimulus.  The  easy  condition  in  the 
BAT  Decision-Making  Task,  as  well  as,  the  Baseline  and  Speed  Level  CRT  tasks 
appear  analogous  to  the  Project  A  CRT  task. 

Perceptual  Speed  and  Accuracy  (Table  10).  One  may  describe  thi6  task 
as  a  SAME-DIFFERENT  judgment  task  or  a  computer-administered  clerical  test. 
By  incorporating  this  Project  A  task  within  the  SAME- DIFFERENT  paradigm,  one 
may  conceptualize  this  task  as  a  variant  of  either  the  Posner  task  (which 
requires  distinguishing  between  nominal,  physical  and  categorical  identity), 
or  the  Figural  Comparison  task  (which  requires  identification  of  geometric 
figures  with  various  degrees  of  similarity)  or  the  Encoding  Task  (which  is  a 
Posner  task  by  a  different  name).  One  may  hypothesize  that  the  most 
analogous  trials  of  the  Figural  Comparison  Task  to  the  Perceptual  Speed  and 
Accuracy  Task  would  be  the  Figural  Comparison  trials  that  require  detailed 
search  rather  than  search  for  readily  discriminate  differences.  One  may 
hypothesize  similar  relationships  between  Attribute  Comparison  and  Percep¬ 
tual  Matching  Tasks  with  the  Perceptual  Speed  and  Accuracy  Task.  The  most 
analogous  task  to  Perceptual  Speed  and  Accuracy  appears  to  be  the  Alphanume¬ 
ric  Series  Matching  Task. 


One  possible  source  of  confusion  is  the  BAT’S  Perceptual  Speed  and 
Accuracy  Task.  This  task  actually  requires  a  motoric  response  to  each 
symbol  in  a  series,  rather  than  the  scanning  of  two  series  of  symbols  to 
decide  whether  or  not  they  match. 

Target  Identity  (Table  10).  Tests  suggested  as  analogs  to  the  Target 
Identity  Task  are  those  that  require  comparison  of  geometric  figures  of 
varying  difficulty  (Figural  Comparison)  and  identification  tasks  with  an 
angular  rotation  independent  variable  embedded  within  the  task  (Mental 
Rotation,  Rotated  Figures).  . 

Short-Term  Memory  (Table  11).  The  short-term  memory  task  is  used  in 
various  programs.  The  task  may  use  numbers  or  letters  as  stimuli.  Project 
A  varies  memory  load  as  does  the  BAT  program,  while  the  other  Air  Force 
programs  vary  memory  and  display  loads.  Neisser's  task  requiring  search  for 
'presence*  is  also  listed  here.  The  Memory  for  Position  Test  employs 
memorization  of  a  sequence  of  lights  as  the  stimulus  memory  load. 

Number  Memory  Test  (Table  11).  Analogs  of  Project  A’s  Number  Memory 
Test  come  in  various  forms.  The  most  analogous  appears  to  be  the  Arithmetic 
Tracking  Task.  The  other  tests  listed  require  associating  a  letter  with  a 
value  and  performing  numerical  operations  with  the  letters.  A  slight 
variation  of  the  number-letter  association  is  the  association  of  geometric 
figures  (e.g.,  bombers)  with  certain  values  and  determining  the  ratio  of  the 
values  for  oneself  and  one’s  'opponent*.  This  latter  task  is  called  the 
Strategic  Decision  Test. 

Cannon  Shoot  Task  (Table  11).  The  suggested  Cannon  Shoot  analogs 
appear  to  require  that  the  subject  determine  a  trajectory  and/or  its  point 
of  intersection.  The  tasks  may  have  the  target  move  or  the  target  and  the 
figure  firing  the  trajectory  move. 

Psychomotor  Task  (Table  12).  Analogs  of  the  Project  A  psychomotor 
tasks  require  maintaining  a  marker  position  while  performing  a  compensatory 
task  of  varying  difficulty  (Time  Sharing).  Also  included  are  two-handed 
coordination  tasks. 


A  Summary  of  Similarities  Between  Project  A  and  the  Other  Services 


A  number  of  predictors  used  by  Project  A  are,  thus,  analogous  to  tests 
being  developed  by  the  other  services.  These  'common*  predictors  include 
Assemble  Objects,  Number  Memory,  Memory  Scanning,  Rotation  and  Target 
Identity,  Reasoning  Tests,  Perceptual  Speed  and  Accuracy,  and  Cannon  Shoot 
and  Psychomotor  Tests.  The  following  brief  descriptions  identify  those 
constructs  that  were  suggested  in  the  previous  section  to  be  found  among 
both  to  the  Project  A  tests  and  the  Air  Force  or  Navy  tests  described  in 
this  report. 


The  Number  Memory  test  requires  updating  Information  through  arithmetic 
computation.  Memory  Scanning  captures  subject  scanning  strategy  for 
information  in  short-term  memory.  The  Assemble  Objects  Test  looks  at 


36 


components  of  visual  memory  which  require  manipulation  of  information,  such 
as  assembling  and  reorienting  parts  of  a  figure  to  form  a  whole  figure. 

Other  tests  which  look  at  visual  memory  characteristics  include  the 
Object  Rotation,  Target  Identity,  and  Perceptual  Speed  and  Accuracy  Tests. 
These  three  tasks  may  also  be  described  as  SAME-DIFFERENT  Judgment  Tasks,  a 
subject  area  within  experimental  psychology  containing  formal  models  that 
allow  for  predictions  of  performance  patterns  across  the  stimulus  parameters 
within  these  tasks. 

Reasoning  tests,  although  being  employed  in  various  forms,  essentially 
require  detection  of  a  pattern  among  stimuli  and/or  determining  the  next 
stimulus  for  that  pattern.  This  type  of  behavior  has  been  extensively 
studied  in  the  concept  formation  literature,  with  its  formal  models  pre¬ 
dicting  performance  across  stimulus  parameters. 

Finally,  tests  similar  to  the  Project  A  Cannon  Shoot  and  Psychomotor 
Tasks  require  anticipating  and/or  intersecting  with  a  point  in  a  trajectory. 
These  type  of  tasks  appear  to  differ  by  (a)  the  type  of  moving  objects 
(target  versus  object  that  is  firing),  (b)  amount  of  moving  objects,  and  (c) 
the  coordination  of  responses  required  to  execute  the  anticipation  and 
intersecting  behaviors  (joy  stick  versus  a  mechanical  slide;  continual 
following  of  target  versus  firing  from  a  fixed  position). 


?ifferences  Between  Project  A  and  Other  Services 


The  Project  A  measures  do  not  include  tasks  employing  the  paired-asso¬ 
ciates  paradigm,  which  allows  for  the  isolation  of  the  acquisition,  reten¬ 
tion  and  retrieval  stages  of  learning.  The  Air  Force  appears  to  be  making 
extensive  use  of  this  paradigm  by  manipulating  variables  that  differ  in 
memory  load  and,  visual  and  linguistic  complexity,  and  observing  the  effect 
of  these  variables  on  individual  differences  in  learning  various  tasks. 

These  tasks  appear  to  include  components  of  job-relevant  behaviors  that  have 
been  modified  to  allow  for  systematic  study  of  individual  differences  by 
thi6  paradigm.  One  cannot  state  that,  based  on  the  descriptions  in  Christal 
(1984 ,  1985),  the  component  behaviors  were  identified  by  formal  job  sampling 
techniques.  One  may,  instead,  state  that  the  behaviors  may  be  representing 
hypothesized  components  of  a  job. 


Three  test-administration  areas  in  which  the  Project  A  computer  tasks 
appear  to  be  different  than  the  other  service’s  computer  tasks  are  in  number 
of  trials  per  task,  dependent  measures  of  interest  and  resolution  of 
reaction  time  measurement.  Project  A  computer  tasks  have  fewer  trials  per 
task  than  are  found  for  analogous  tasks  employed  by  the  other  services. 
Examples  of  some  of  these  differences  are  noted  in  the  discussion  on  the  Air 
Force  Baseline  Tests.  One  may  pose  the  question  of  whether  the  Project  A 
computer  tests  are  currently  capturing  acquisition  or  stabilized  performance 
measures.  One  may  also  argue  that  the  other  services  are  capturing  data 
that  provide  a  more  detailed  look  at  the  parameter  differences  within  each 
of  these  experimental  tasks.  At  issue  is  whether  these  differences  are  job 
relevant. 
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Interservice  differences  are  found  in  the  measurement  of  reaction  time 
as  a  dependent  measure.  Project  A  separates  a  subject's  reaction  time  into 
Decision  and  Movement  Times.  Decision  Time  represents  the  interval  between 
onset  of  the  stimulus  to  which  the  subject  responds  and  the  time  the  subject 
initiates  the  response.  Movement  Time  is  the  time  from  response  initiation 
to  completion  of  the  response.  The  other  research  programs  do  not  appear  to 
make  the  Decision  and  Movement  Time  distinction.  Rather,  they  measure 
Reaction  Time  as  the  subject's  total  time  from  stimulus  onset  to  pressing 
the  button.  Jensen  is  a  proponent  of  the  Decision  and  Movement  Time 
distinction  (Jensen  &  Munro,  1979)  while  Longstreth  argues  against  it 
(Longstreth,  1984). 
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A  related  issue  for  the  measurement  of  reaction  time  is  the  assumption 
of  a  strong  association  between  the  stimulus  and  its  associated  response. 
That  is,  one  vould;not  want  to  confound  measurement  of  a  subject’s  decision 
to  respond  to  a  stimulus  with  the  subject's  "figuring  out"  the  correct 
response  button  to  press  to  represent  his/her  decision.  Standardization  of 
response  panel  design  and  of  the  necessary  number  of  warm-up  trials  to 
insure  sufficient  stimulus-response  association  appear  as  readily  approach¬ 
able  areas  for  interservice  cooperation.  However,  the  theoretical  arguments 
regarding  the  "purity"  of  the  Decision  Time  measurement  would  still  remain. 

The  third  test-administration  issue  concerns  the  sensitivity  of  meas¬ 
urement  of  a  subject's  performance  (McHenry  8  McGue,  1985;  Rosse,  1985). 

The  Air  Force  employs  a  Perceptual  Threshold  Task  that  presents  stimuli  for 
only  17  msec.,  suggesting  that  the  Air  Force  employs  sophisticated  computer 
programs  with  a  1  msec,  resolution.  The  Project  A  Computer  battery  has  a  10 
msec,  resolution  (C.  B.  Walker,  personal  communication,  1986). 

As  one  reviews  this  report’s  extensive  list  of  computer  tests,  one 
realizes  that  the  use  of  a  microcomputer  as  an  instrument  to  test  the 
competency  of  a  cognitive  skill  represents  a  technological  breakthrough  in 
behavioral  assessment  and  skills  training.  However,  technical  problems 
exist.  The  more  dramatic  technical  problems  for  consideration  when  using 
the  microcomputer  as  a  scientific  instrument  include  the  use  of  software 
that  allows  for  sensitive  stimulus  presentation  parameters  and  sensitive 
measurement  of  subject  behavior.  The  sensitive  unit  of  measurement  in  reac¬ 
tion  time  tasks  is  typically  1  msec.  Computer  programs  having  millisecond 
accuracy  have  been  written  that  allow  for  such  on/off  stimulus  presentation 
and  subject  measurement  (Dlhopolsky,  1982).  Identifying  how  millisecond 
resolution,  response  panel  design  and  other  problems  (Lincoln  &  Lane,  1980; 
Rosse,  1985)  are  being  solved  provide  an  avenue  for  cooperation  in  test 
development  among  the  services. 

One  other  difference  between  Project  A  and  the  other  services  is  Pro¬ 
ject  A’s  dropping  the  Shapes  test  from  the  predictor  battery.  For  example. 
Table  8  describes  an  embedded  figures  task  that  is  used  by  the  Air  Force 
that  is  analogous  to  the  Shapes  test.  The  Shapes  test  was  originally  part 
of  the  Project  A  battery  but  was  dropped  because  of  time  constraints  in  test 
administration  and  because  it  was  felt  that  other  tests  such  as  the  Assemble 
Objects  Test  provide  sufficient  overlap  with  the  ability  tapped  by  the 
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Shapes  Test.  One  may  still  want  to  keep  the  Shapes  Test  on  the  "back 
burner.*  Forms  of  Embedded  or  Bidden  Figures  tests  have  strong  relation¬ 
ships  with  target  detection  and  identification  tasks  (Bone,  1978;  Thornton, 
Barret  &  Davie,  1968),  automobile  driving  behaviors  (Mihal  &  Barrett,  1976), 
and  other  tasks  or  situations  that  would  be  of  interest  to  the  Army  and  the 
other  services  (cf..  Long,  1972). 

Again,  the  other  services'  research  programs  covered  in  this  report  do 
not  appear  to  be  employing  analogs  to  the  Project  A  Scanning  Tasks. 

Potential  Predictors  Not  Included  in  Any  Service  Battery 


Measures  of  selective  attention  or  dichotic  listening  (e.g..  Gopher  6 
Kahneman,  1971;  Gopher,  1982)  do  not  appear  that  popular,  although  other 
paradigms  reflecting  channel  capacity  or  attentional  demand  models  are 
employed.  Examples  include  the  BAT'S  Time  Sharing  Task  and  the  Air  Force's 
Working  Memory  Battery.  One  example  of  a  dichotic  listening  task  is  found 
in  the  Tri-Services  Test  Battery.  This  battery  was  not  reviewed  by  this 
report,  although  Christal  (1985)  does  list  the  battery,  with  brief  descrip- 
ti  ns  of  each  test. 


The  low  emphasis  that  the  services  appear  to  be  giving  channel  capacity 
measures,  as  in  the  Broadbent  Model  (c.f.,  Broadbent,  1958;  Kahneman,  1973) 
when  selecting  tasks  to  represent  components  of  an  information  processing 
model  should  be  recognized.  Such  a  shift  in  the  definition  of  information 
processing  may  be  resulting  in  test  batteries  that  are  not  taking  full 
advantage  of  certain  potential  measures,  which  to  paraphrase  the  intent  of 
the  Air  Force's  BAT  program,  require  that  the  subject  quickly  sort,  priori¬ 
tize  and  act  on  a  continual  stream  of  visual,  auditory  and  tactile  informa¬ 
tion. 


One  may  argue  that  the  Project  A  Number  Memory  and  Psychomotor  Tests 
represent  tasks  requiring  updating  and  responding  to  a  continual  stream  of 
information.  However,  the  abilities  of  quickly  sorting  and  prioritizing 
information  do  not  appear  to  be  as  obvious  for  those  tasks.  Perhaps, 

Project  A  measures  may  not  have  been  designed  to  capture  these  'sorting* 
abilities  because  these  abilities  may  not  likely  show  predictive  validity 
for  Army  Jobs. 

The  Annett  Handedness  Scale  (Arrnett,  1970),  another  unique  measure  not 
discussed  in  the  present  report  is  a  12-item  self-report  questionnaire  being 
employed  by  the  United  Kingdom  (Christal,  1985).  The  scale  allows  for  a 
continuous  (as  opposed  to  dichotomous)  measure  of  handedness,  an  indirect 
measure  of  laterality  (Hardyk  &  Petrinovich,  1977).  The  laterality  con¬ 
struct  has  been  shown  to  be  related  to  spatial  abilities,  which  appear  to  be 
given  a  strong  emphasis  by  the  Project  A  predictor  battery.  One  possible 
relationship  of  interest  is  that  between  laterality  and  a  criterion  task 
predicted  by  spatial  abilities.  Such  a  relationship  may  carry  implications 
for  equipment  design  and  training. 
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CONCLUDING  COMMENTS 

It  appears  that  the  services  are  Identifying  profiles  of  ability 
competencies  and  critical  job  behaviors,  and  to  various  degrees  attempting 
to  establish  relationships  between  the  two.  Various  paradigms  and  tasks  are 
being  employed  to  measure  and  assess  many  skills  and  abilities.  Measurement 
instruments  are  being  designed  to  be  sufficiently  sensitive  to  the  behaviors 
of  interest  (e.g.,  microcomputer  programs  that  employ  the  msec,  as  the  unit 
of  measurement  for  reaction  time  tasks,  and  GO/NO  GO  behavioral  checklists 
for  gross  behaviors,  such  as  replacing  a  wheel-bearing  on  a  2  1/2  ton 
truck). 

Project  A  may  be  considered  part  of  this  concerted  effort,  with  its 
concentration  on  identifying  and  furthering  the  conceptual  and  technological 
breakthroughs  in  human  assessment  and  classification.  As  Hakel  (1986) 
states,  'Every  major  issue  in  the  science  and  practice  of  making  personnel 
decisions  is  being  addressed*  (p.  373). 

But  as  Hakel  also  points  out,  'Project  A  won't  have  all  the  answers  and 
it  won’t  put  the  rest  of  us  out  of  business.*  One  may  argue  that  the 
employment  of  other  experimental  paradigms  for  both  the  predictor  and 
criterion  sides  of  performance  assessment  by  the  other  services  suggests 
that  Hakel  is  correct.  There  is  an  information-rich  and  burgeoning  tool  kit 
that  may  be  called  upon  for  reliable  human  assessment. 

Recognition  of  the  information  that  the  tools  (both  conceptual  and 
technological)  were  originally  designed  to  tackle  may  provide  a  guide  for 
identifying  what  questions  each  service  is  or  is  not  answering.  This  report 
may  provide  some  help  toward  identifying  the  overlaps  and  distinctions  among 
the  services  by  identifying  their  respective  methodologies  and  constructs  of 
interest,  which,  it  may  be  argued,  are  reflecting  the  questions  and  answers 
on  which  their  respective  efforts  focus. 
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